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ABSTRACT . ^ ^ ' ' - 

This volume is one of the products of the knowledge 
development effort implemeiTted under the mandate of the Youth 
Bmplotmen* and Demonstration Projects Act of 1977. It is a report of 
an assessment stud(y designed to determine the status and results of 
the implementation of mixed income experiments at 47 Comprehensive 
Employment arid Training Act <CETA) sites' during fiscal years 197,3' and 
19 79. Mixed income experiments are designed, to test whether and/or to 
what extent ineome-eligible youth benefit |roa working with and being 
trained alongside noninqome-*^eligible youth, as opposed tcf recei/vi^hg 
the same services in projects ^ere all participants are incoiae 
eligible. Data were collected from program plans' and project reports^ 
telephone inquiries to prime sponsors, and sit^ visits^ Ihe conduct 
of these mixed income experiments and their individual ^ findings vary 
significantly, making any aggregate analysis difficult; Each of the 
tests in varying degrees failed to meet accepted practices in 
research methodology, and therefore the results of this Icliowledge 
effort are inconclusive. From what operational data were gathered, 
however, no conclusive evidence of benefit to yduth participants was 
showm^ and no change in low-*income guidelines for participants^ is 
warranted. The mixed income hypothesis, however, does warrant further 
investigation. It is recommended that future experimental efforts 
follow stricter research guidelin^i^. (The report includes a « brief 
case studjLOf the tests, cojiducted.) (Other youth knowledge 
development reports are available through EEIC--see note.) (KC) 
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OVERVIEW 



A fundamental youth policy issue is the degree 1:o which employment 
and training. resources should be targeted according to famil^ or 
household income. The in'cidence and severity of education and 
employment problems arev correlated with family income, so that tar- 
getting achieves its^ fundament;al mission of concentrating resources 
.on a group mog^t likely to have p^roblems. - However/ what hold§ in the 
aggregate does not hold^ iji individual cases.' Many youth 
fi^om low-income families need help less than other youth , 
from somewhat, more affluent families. Income certifica- 
tion creates significant administrative problems. Segrega- 
^on of youth by income migbt reduce community .support for 
employment and training programs. Segregation might also 
rspduce -the developmentaT opportunities of low-income 
youth by removing them from contapt and interaction 
wi-tt^a more diverse group, or >by "negative labelling" which 
affects their own self-perceptions or those of, employers 
who view participants as a group selected because of^ problems. 

There is, thus, a tradeoff between the use of tight income 
etigibili):y standards to concentrate resources on youth 
most in rieed, and less restrictive standards which are easier to 
administer, which may establish a broader base of community sup- 
port, which may reach youths ix^ need who are not' poor, and which may 
improve the experience of the. low-incomW youth by reducing negative 
labelling and increasing the sphere of social interaction. 
The terms of the tradeoff have not been documented,"" ' Research 
provides evidence concerning the correlations between individual 
need and family income but the benefits of less restrictive- 
standards have not been measured. 

To address one aspect of ihe .tradeoff, the Youth Employment 
and Denjonstration Projects Act authorized that ten percent 
of the funds under Youth Employment a,nd Training Programs ^ 
"may^be used .by programs which include youths of all 
economic backgrounds to test the desirability of serving youth 
of all economic backgrounds." The regulations provided for 
local prime 'sponsors to use their "formula funds for ^'Ten 
Percent Tests": , 

• ' » 

' "A^prime sponsor may design a special component 
u0Tng up to iQ percent of 'its YETP funds for programs to v 
serve a mixture of youth from families above and below • , 
the (YETP eligibility) income leVel... 'the program should. 



y ■ ' - ■ \ 



test whether and to what extent irfcome eligible yot^feh 
benefit from participating in programs designed to serve 
youth, from all economic backgrounds. This special component 
. 3hall : - \. » 

^ ' / 

(1) Have and follow a structured experimental design; 

(2) Establish and use comparison groiips;- • 

^ (3) Provide for followup (^/participants; and * 

(4) Provide in ari. Annua*l Narrative Report a followup 
on the experimental outcomes." 

Specif i'c Qiiidance was also given on experimental design options 
(included in the appendix to this report). 

During Fiscal Years 1978 and 1979', 47 ym^xed income tests were 
proposed by 36 prime sponsors in eigl3± regions of the country. 
This report provides an analysis ^of the tests -and their 
results. ' ^ ^ w , ' ' 

The evidence is inconclusive about- the impacts o£ mixing on ' 
economically disadvantaged youth. Most of the tests them- 
selves laclced the rigor or scdle to draw definitive conclu-^ 
sions. The mbre structured experiments produced eviderlce 
of positive impacts in some cases and no noticeable impacts 
in others. If the null hypothesis is- that income mixiifg 
will not alter the experience of low-income participants 
enough to offset rejiiiced services due to the allocation of 
resources to youth with greater income, this hypothesis is 
,not overi;urned by the evidence. The impacts, where 'they 
were measured, were very modest. ^ 

Ipcome' tes.ts were an -attempt by prime sponsors to respond ( 
to the local knowledge development mandate. Review of the 
tests as "structured experiments" sug'^ests the limitations of 
this type of approach. The. "batting ayerage" of successful 
implementation was low, sample sizes were necessarily limited, 
and the designs and instruments varied so much that 'the 
results are* difficult to compare across sites. Where . 
successfully implemented,* the experiments have ^n effect 
on local policy and'jnay be important from a process sense 
although not in terms of reach4.ng conclusive findings. 

There is clearly a need for standa'tdized assessment and 
structured experiments in multiple sites. * A "m^ixed-income 
demonstration" has, therefore, been initiated in five sites 



under national funding and* direction . It provides greater 
qontrol o\i the income differentials between experimentals 
and controls, specifies the level of interaction for mixing 
within activities , ^and standardizes the measurement tools,. 
Unquestionably, this demonstration will provide^more conclu- 
siye 'eviderfce d^^ncerning impacts. 1^ 

Ort the otl^r hand, the prime sponsor tests, with all • 
their limitations, provide an impor-tant polic^ baseline « 
In^-'an operational setting, the effects of mixing are 
ap^areniilyjyi^otNso great that one could advocate change 
in Incom^eligiDility standards based on projected benefits 
to low- income youth from interaction with others. 

Income mixing across all local prjigr'ims rather tlian \a an 
isolated experiment' m^ght change tt\is finding by making 
CETA participants more, attractive to employers and by inq^pea 
ing public support. ' It hiight open the programs to ycnith m 
need but above the incoine standard (although if this ,Oscurs 

•i^is questionable wheiiier the Iqw-i-ncome participants' 

woxild benefit from intdtaction with others who have just as 
promems). Less restrictive income eligiblity might be 
desirable for political, or administrati-ve reasorfs. ^owever, 
it does not appear that" its impacts on low-income /outh ■ 
are a major justification. 

This volume is one of the products 6f the "knowledge 
development" effort implemented under the mandate of, the 
Youth Employment and ^Demonstration Projects^ Act of 1977. 
The knowledge development effort consists df hundreds' of 
separate research, evaluation and demonstration activities 
which wilX^result in lit.erally thousands of written products 
The activities have been structured from the- outset so 
thatf^^ach is self-standing but also interrelated with a h'ost 
o^ other activities. The framework is presented in A „ 
K nowledge Development Plan for t]}e Youth Employment- and 
De monstration Projects Act of 1977, A Knowledge DiveloiDmen t 
Plan for the ^oiith Initiatives Fiscal 1*979 and Completing 
the Youth Agenda: A .Plan for iKnowledqe Development, 
Dissemination and Application for Fiscal 19'80 .' • ^ 

Information IS available .'or will be. coming available from 
these various knowledge development efforts to^help resolve' 
an almost limitless' array of issues. However, policy and 
practical. application, will usually require integration and . 
synthesis from a wide array of products, whi^h., m turn, 
depends on knowledge ^nd availability of these products. 
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A major shortcoming of past research, evaluation and demon- 
stration activities has been the ^ failure to organize and 
disseminate the products adequately to assure tff% full 
exploitation of the findings J The magnitude and structure 
of the youth knowledge development effort puts a premium on 
structured analysis arid wide dissemination. 

As part of. its knowledge development mandate , therefore, 
the Office '^f Youth Programs of the Department of Labor will 
organize, publish and disseminate the written products of 
all major research evaluation and demonstration activities 
supported .directly by or mounted in conjunction with OYP 
knowledge development efforts. Some of the same products 
may al^o be published and^disseminated through other channels, 
hnt they^^Tll be included in the structured series of 
Youth Knowledge Development Reports in order to -facilitate 
access ancj integration. 

The Y outh Knowledge Development Reports , of which this is 
one,' are divi<^ed :into twelve broad categories^ 

1. Knowledge Development Framework : The products in 
this category are concerned with the structure of knowledge 
development activities*, the assessment methodoldgies 
which are employed, the^ measurement instruments and their 
validation, the translation of knowledge into' policy, and 
the strategy for dissemination of findings. ^' y 

, , i 

'2. Research on Youth Employment and Employ ability. 
Development ; The products in this category represent analyses 
of existing . data/ presentation of tindin^s from new data 
sources, special studies of dimensions of youth labor market 
^ETQblems, arid policy *issue assessments./ ^ 

^- 3. Program Evaluations : The products in this category 
include impact, process and benefit-cost evaluations of 
youth programs including i;he Summer Youth Employment Program, 
Job ^^Corps,. the Yoiing Adult . donseryation ^Corps, Youth Employ- 
ment ^and Training Programs, Youth Community Conservation 
and Improvement Projects- and the Targeted- Jobs Tax Credit. 

4. Se.r\)!ice and Participajit M ix: The evaluatiotns ^nd 
demonstrations summari zed in , this category coricern the mat??:h- ' 
ing of different types of youth wittT>^ different Service * ^ 
'combinations • Thi^ involves experiments wit^h work vs. 
work plus remediation- vs. straight remediation as trealfment 
optioivs. It 4lsq includes attempts to mix disadvantaged 
anj^'morfe affluent participants, as well as youth with older 
workers* • ^ . ' 

• ^ ■ ■ ' ■ ■ X • . 
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5. Education and Training Approaches : The products 
in this category present the findings of structured experi- 
ments to tes't the impact and effectiveness of various educa- 
tion and vocational training apprOach^s. iiu^luding specific 
education- methodologies 'fot the disadvantaged, alternative 
eSucation approaches and advanced career trainiiig. 

6: Pre-Employment and Transition Services ; The ^ 
products in this category present the findings of structured 
experiments to test the impact and effectiveness of school- 
to-work transition activites^ vocational explora^tion , job- 
search assistance and other effdtts to .better prepare youth 
for labor market succtess. • I * ' 

7. Youth Wo;rk ExpetienQe ; The products in this category 
address the 'organization of work activities, their 6utput, 
productive 'roles for youth and the iippacts of various 
employment approaches. ^ 

8. Implementation Issues: This category mcljades 
cross-cutting analyses of the practical lessons concern "how- 
to-do-it." Issues such as learning curves^ replication ^ 
processes and programmatic -^"bat^^ing averages" wijl be 
addressed under thib category f as ^ well as the comparative 
advantages of alternative delivery agents. 

' 9. Desj/gn arid Qrganjzatipnal Alternatives: The 
products m this categpry represent assessments o£ demon- 
strations of alternative pi^ogram and/delivery arrangemertts 
such as consolidation, year-round preparation for. summer 
programs, the use of incentives and' multi-year tracking of- 1 
individuals. 



10. Speodal Needs 'Grpup s : The products In this category 
presents findings on the special problems ^f and the 
programmatic adaptations needed for significant seginents 
including minorities young mothers^ tr.oubled youth, 
Indochinese refugees- and the handicapped. 

11. Innovative Approaches : The products' in this 
category presents the findings of those activities- designed . 
to explore new approaches. The subjects covered incliade 
the Youth Incentive Entitlement Pilot J^rajfects, private 
sector initiatives, the national youth' service experiment, 
and energy initiatives' in weatherization, low-hea^J hydro- 
electric dam restoration ,-2\/indpower and the like. 
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12. Institutional Linkages : The products in this category 
include studies of institutioaal arrangements^ and linkages as 
well as assessments of demonstration ^activities' to encourage such 
linkages with education, volunteer gyroups, drug abuse and other 
youth servir\g agencies* 

In^each of these knowledge development ^c^tegories , there wilT be 
a range of discrete demonstration, research and evaluation 
activities focused on different policy, program and analytical 
issues. In* turn, each discrete' knowledge development project 
may have a series^ of written products addressed to different 
dimensions of the issue. , For instance, all experimental 
demonstration projects have both process" and impact* evaluations, , 
frequently undertaken by different evaluation agents. Findings 
will be ojfiblished a'S. they become available so that there will 
usually ae a -series of reports as evidence accumulates. To 
organize these produc^ts, each publication is classified in one^^ 
^pf the 'twelve broad knowledge development categories, described in 
terms of the more specific issue, activity or cluster of activities 
to which it is addressed, with an identifier of the product "and 
whatsit represeivba, relative to other products of the demonstrations. 
Hence, the multiple* products under a khpsatledge development activity 
are closely interrelated ajid the activities in each broad cluster 
have significant interconnections. . 

This report orPprime sponsor activity should be read in conjunction 
with the forthcoming results of Jh e Mixed I ncome Demonstration in th 
"service ^d participant mix'* category. As background ,a tne 
corTe4^ations between family income and employment or educational 
problems are identified in several of the volumes in the "research! 
on youth employment and employability development" category, ^ 
particularly A Review of s Youth Employment Problem?, Programs and 
Policies . Finally, the local knowledge development experience 
'has i^iplications for conclusions about prime sponsors' research 
and evaluation capacity as assessed in Youth' and the Loca l 
Employment Agenda in the "program evaluation's" category as well 
Evaluative Research in Local Youth Programming in the "knowledge 
development framework" category . - ' 

■ . r . ■ ^ 

' - .' ) . 

' > . : rdbe'rt taggart 

Administrator f 
; • ^ Office pf Youth Progi/ams 
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■ . EXECUTIVE SUMMARY 

/ . . • 

Mixed income experiments jire designed to test whether and/or to , 

wh&t extent income-eligible youth benefit from working, with and being 
trained alongside noninCome-eligible youth, as opposed to receiving the 
same services in projects where all participants are' income eligible. 
The mixed income experiment is presented in the Comprehensive Employment k 
and Tra.inirtg Act as an optional program/activity for prime sponsors and' 
is part of an overall knowledge development effort-of the Office of Youth 
Programs. This state of the art report presents the status and results of 
the mixed -income experiments 6on(Jucted by pri'me sponsors in fiscal years 
197S and 1979. 

Forty-seven tests of the mixed income hypothesis were-propbsred by 
36 prime sponsors i^n ejght regions -of the country. Twenty-nine tests were 
completed in FY 1978; fourteen are in operation in *FY 1979; three were 
proposed but never implemented and no information was obtained on one.- 
The conduct of these mixed income experiments and their inli^idual findings 
vary, significantly making any aggregate analysis difficult. Each of the ■ 
tests ip. varying degrees jfailed to (1) adhere to the research g uideli nes 
established by the Office^ of Youth Programs ,-t?T specffy variables in_ 
* oprratiorled or TOasurable terms, (3) insure adequate sample Isize and/or 
appropriatel control groups^, (4) adequately monitor data collection processes 
(5) utilize appropriate or adequate testing^^^^ruments , (6) allow suffi- ^ 
cient time for the program effort and (7) provide sufficient^ foil ow-yp 
to determine the effect^of the mixed income tesUng. The results of this 
knowledge development efi;ort are, therefore,' qui tjb inconclusive. 

The mixed income hypothesis, howeyer, does warrant further investi- 
gation. It is thejefore recommended that future experimental efforts 
d') operationalize th6 variables of age^ sex, ratio of income eligible to - 
nonincome eligible, level of interaction, t^pe of progpam and extent of 
income diff^ential, (2) control" for attrition and confidentiality, ' 
^ (3) utilize standard and appropriate pre- and post-test instruments , '- 



(4) implement standardized follow-up procedures and (5) require a six- 
month minimum length of program involvement. 

This assessment of the status and results of the mixed income 
experiments was conducted by Mark Battle Associates, Inc. under contract 
to the Office of Youth. Programs, U.S. Depa.rtment of Labor. The analysis 
was based on data collected from three sources: (1) secondary sources, e.g 
program j)lans 'and project reports, (2) telephone inquiries wxtb regional 
and local prime sponsor personnel, and (3) site visits to selected prime 
Sponsors who conducted the mixed income experiment. The report describes 
the types of tests engaged in, elements examined and elaborates on the 
findings and recommendations briefly presented here. ■ The report also 
provides a brief case study for each of the tests' conducted as well as a 
'list of respondents in the telephone inquiries and site visits. 
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. CHAPTER I 
INTRODUCTION 

■ Mark Battle Associates (MBA), under contract to the Office of -Youth 

« 

Programs (OYP), has prepared a report of an assessment studyjdesigned to 
determine the ^status and results of the implementation of mixed income 
experiments at 47 sites. The mixed' income exp|riments are an authorized 
utilization of ten" percent^f a local prime sponsor's youth employment and 
training program (YETP) budget for conducting this special test. The mixed 
income experiment is one approach to- knowledge development in the Youth 
Employment and Demonstration Programs Act (YEDPA). This chapter describes 
the mixed income experiment. 

The Purpose of Knowledge Development Initi'atives in the Department of Labor • 
Oyer the past several years the Department of Labor. (DOL) has found it 
increasingly important to not .only document employment and 'general manpower 
trends but to describe the theoretical nature of these trends. It has become 
more important to engage in "bagic research to develop knowledge about the • 
employment trends rather^' than merely reportiiig an unemployment rate.N This 
researctrts destgned^ ta tietermine what" works tes^t— for^hom and-under what 
conditions. " .> ' 

« 

J<nowl edge development, then, is basic research conducted by DOL to ask 
the difficult questions about employment, training and general manpower 
development. . The results of stieh investigations are to be used as a basis for 
improving the delivery of department services, V ^ 

^Office of Youth Programs Knowledge Development Efforts 

The Office of Youth Programs in "Wie Department of Lefbor 'has authorized, 
many approaches to knowledge development. Each approach has sought to explore 
at least one method of deducing the structural unemployment problems of the ^ 
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nation's youth. It was intenjJed that the results of these variou^ studies 
would be .used as a b$isis for improving the format and implementation of 
future^ employment ^nd training programs for youth. 

As one approach, to such exploration*. Section 345(a)(2) of the Youth 
Ertiployment and Demonstration Programs Act authorizes the'use of ten percent of 
the funds available for youth employment and training programs to include 
youth from all economic backgrounds in order to test whether and/or to what ex- 
tent "^income-eligible youth (those whose family income' is no more than 85 
percent 0/ the lower living standard income level) would benefit from working 
with and beiiig trained alongside nonincome-eliqible youth as oyosed to 
receiving the same services in projects -where all participants are income 
eligible. This is the miked income experiment. 

Rationale for the Mixed Income Experiment ♦ 

There are widely varying viewpoints about the wisdom of targeting 
programs for the most economically disadvantaged. These viewpoints need 
to be urfderstood in designing any test of income mixing. Arguments against 
targeting usually begin with the claim of vertical inequities,- i.e.^ 
youth above any arbitrary income cutoff may be as much in need as those ^ 
below. .4^rqeting-is^ustifi«d by the belief scarce, resources should 
rgo to those most in need and tha1;^the income eligibles have far more severe 
problems than those not eligible. For YETP, .Congress .has limited the more 
costly services to the more, economically disadvantaged pr'income-eligible 
youth from families with incomes less than 85 percent of the Ipwer living 
standard income level. ' • 



The mixed income experiment, on the other hand,' allows for a portion 
of J: he. YETP budget to b^e^used for the over income (nonincome eligible) when 
such is done in the corftext of ,a knowledge development test. ^ The concept 
being tested relates to paKicipant grouping and asks whether income-eligible 
youth are better served in homogeneous or freterogeneous groups. Some of the 
possible behefits the income-eligible youngsters may receive from mixed income 
grouping (heterogeneous) are noted: 

17 
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1. In mixed income groups, program effectiveness may^ be increased 
because of the presumed availability of positive Vole models 
among the participants. Therefore,* the over income youth would 
positively influence the income eligible. 

2. "tbuth are highly ^sensitive to peer group pressUVe, apd a mixed 
income groups may ^increase the chances of that peer group sup- 
porting positive attitudes toward self, work and society in 
general . 

3. Prospective employers may be more willing to take a cjiance on 
a lower income youth from a program which is not economically 
targeted than from one where alTparticipants are known to be 
poor. ^ 

Opponents have not denied the above clafms, but they hsve raised ar- 
guments against the use of scarce resources for those above the usual income 
cutoff figure. Furthermore, it is not clear that the possible benefits to 
income-eligible youth in mixed groups would be greater than the loss of pro- 
gram spacfes 'for other income-eligible participant^. 

It is an open issue but one worthy of investigation. Income mixing 
under YETP projects has been- allowed but has been limited to {jrescribed 
structured experiments and only ten percent of thre total budget, this study, 
agairr, report-s on the- status and results of the ,47 mixed income. tests proposed 
in fiscal years 19J8 and 1979. 

The Structure- of the- I'lixed Income Experiments 

When YEDPA authorized the use of ten percent of the^TP funds for. 
mixed income testing, they also prescribed the hypotheses to be tested and 
the- research design to be used.. Specific treatments d^' services to be^'of- 
fered participants were to be decided on a site-by-site basis and described- 
ii. plans submitted to the respective regiopal offices. 

» Hypothesis ' ' . 

There was only -one hypothesis to test in the mixed income experiments 
(or tests), and that was: 
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\ If income-eligible youth are trained and/or work 

alongside nonincome-eligible youth in a YETP project, 
then the program benefits will be greater for these 
incomer-eligible participants than for similar income- 
^ eligible youth trained only with other income-eligible 
youth. ' ' • ' 

Another way to define the hypothesis is to reduce the language used stating: , 

, ' Heterogeneous grouping (mixed income groups) will 
yield greater results for targeted participants 
(the income eligible) than homogeneous grouping. 

i 

The null hypothesis for either- of the above statements is that income- 
eligible participants will not benefit from mixed grouping in training and/or 
work Assignments. ' ' - , ^ 

The emphasis in the mixed income experiment is on predicted change in » 
the income-eligible youngster. This is the targeted participant who will 
presumably be positively impacted by the presence of and interaction with 
noni>n€ome-eligible yj^ungsters. 

Research Design ~^ ^^^""^ 

A, before-after comparison was needed to test the mixed income hypothesis". 
A control group of income-eligible youth ^not receiving services in a mixed 
income setting had to be established. Pre- and post measures of performance, 
had to be .collected and analyzed. These requirements^ictated the use of a 
pretest/post- test control group research- design that was prescribed by the 
Office of Youth PnSgrams for the conduct ^'the mixed income tests. \ 

The rationale behind the use of a pretest/post-test control group design 
is elegant in its simpflicity. Academicians engaged in research realized that 
they would not know where they had gone nor how great their progress had 
been without plotting the route. The techniques many devised for plotting the 
route included numbers, and numbers Dften implied testing at the beginning and 
the end of a trip. Hence, the widespread use of pre- and post-testing emerged. 
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A second problem academicians had- to ponder was that change is always 
•occurring, and they wanted to know .what factors or services were causing the^" 
phange. They realized that two groups had to He examined. The first group^ 
would receive some service; this' would be the experi(nental group. The second 
group would not receive the service; this would be the control group. The 
results over time for the experimental group and control group could be com- 
pared and whatever differences ^were noted could be attributed statistically 
either to the service or the always present changl^ify chance. Fqr these . 
reasons, the use of control groups- is widely ^accepted a.nd' expected in research. 
Diagram I is the pretest/post-test control group design as it is applied to 
the mixed income experiment. ^ 

* 

^ ' Diagram I 

The Pretest/Post-test 'Control Group Design 
for 'the Mixed Income Experiments 



, Experimental Group 



Control Group 



Pretest 


Services Received 


Post-test 




(Heterogeneous) 
■ Mixed Income Grouping 


X 


X 


(Homogeneous) 
-.Nonmixed Income Grotiping 


■ X f 



The next chapter describes the approach of Hark Battle. Associates to a 
stiTdy of the 47 mixed Income experiments proposed for .fiscal years 1978 and 
1979. • Th*e following chapters present the findings, the state of the an^an4, 
reconimenda,ti ons for future mtxed Income experiments. 
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"CHAPTER II 
DATA COLUECTION PLAN 



• This study was designed to determine the status and results of tKe ^ 
' mixed income experiments being^onducted in ei^ht region^^and to develop . * - 
^^;:^onmendations regarding the nature, scope and research parametfers for ^ 

future experimentation. Three major -approaches ^to data collection-were. used 

in this study. These were: ^ ^ 



1; Analysis of secondary .data such as program plans, 
reports and other written documents 

2. Telephone inquiries with youth coordinators .at the 



. Analysis, of Secondary Data ^ , . . ^ 

The pu^os'es of this apprcrcTCTrRr-^ata collection were- to 'acquire 
familigirity wfth the field of available ten percent tests, and to develop 
reasonable categories fo]>^nalyzing the hypotheses. Four hypotheses were 
identified. 



regional level and program people at the local site level f'" 

V3. Site visits to selecte;l_test locations representing each ■ ." ^ , 
, region, each type of test and other unique features- 

• ' • V 

* t 

' The following data' ^^ecti on plan includes the specifics of each 
aisproach to data collection as used by MBA. 

Approaches to Data Collection ^ ' ' ' .. 



The first hypothesis , sometim^'s' expl icit, always implicit, ran 
/-throughout each of the,tes\s. It was assumed that there was some effect to be 
note^d v/hen income-eligible- and nonincome-el igible youth were mixed in traininq" 
ov other work-related, experiences'. ; It was assumed that thfe nature of the 
•effect would be, po-sitive for the income-eligible (more disadvantaged") youth, 
although thi's possibility was not<>readily a^cknowledged^. It was expe^cted that 
income-eligible youth would show increases in motivation and/or skills as a 
Vesihlt of mixing with other youth TrthrEraiTTi^g" pm»"amr. This hypothesis war: 




•r The general attitude^ and behavior of income-eligible 

youth will change when these ^j^ouths^are trained or 
counseled with nonincome-eligible yout+i. \ / • 

* • • . ^ * J., ^ ^ ' * 

Two of the three^her hypotheses more specifically noted and descrjibed 

the effect discussed above. These were: ' I' ' 

\ / . 

% ^ The intrapersonal ^ritrapsychic c6ping skills ^and ^ 
insights wi 11^ change in th^ income eligible more ^ ^ 

rapidly when he/she isr^mixed wjjth the nonincome 
eligible. 

, ' • The academic and/or ifib- related skills will change 

. ^ in tjie'^income eligibl&^ore Rapidly when^ he/she ^ 

is mixed with the nonirvcome eliSible*. ^ 

_ / ♦ ' 

The fourth hypothesis was as jronspecific as the first except that it was 

applied to physically handicapped youths It was: 
' ' * ' " • * " ^ • ^ . , . \ 

f The genferal attitude and behayi or of physically j 

handicapped youth who are also Income^Tigible will 
change when thes6 youths ^re tfained or counsel e(^ 



with the^'nonincome-eligible handicapped. , ,^ - 



/ 



Theset hypotheses -formed thfe basis of the 'MBA classification of each ^. 
^test (see Table. 51-1, T^pes tff Tests). The category Jjlentjfied' as EXPLORATORY 
includ6j^;0hose ^fee$ts Examining the first hypothesis.* The category identifi^ed 



as AFFECTIVE C'HANGE includes those tests examining ^e second hypothesise^- 
SKILLS. ACQUISITION includes the^third hypothes^is and SPECIAL GROUPS includes 
the fourth hypothesis;' \j' , / ^ 



Telephone Inquiries ^ , - v 

The analysis of seetSftdary data yielded usefU| information; however, many 
voids ^remained. In order'to develop more comprehe'^isi ve descriptions of thi^^ 
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TABLEJI-1. 
TYPE OF TESfS 



Code 



Title 



Explanation * 



01 



02 



03 



04 



Exploratory 



Affective Change 
' (Internal ) , 



Skills'' A^quisitipn 
(External ) 



Special 'Groups 



This category ijacludes all those tests 
in which only some general positive 
benefit "Was predicted; very nonspecific 
predictions'" were generated, ..^ 

This^ category includes all those tests in 
which change was predicted in intraperson- 
al or intrapsychic dynamics, such as 
motivation, self-concept, level of^ aspira- 
tion and the like,. 

This category includes 'all those* tests 
'in which change was predicted iji acacHmic 
or skills achievement; thfes€^a-tfr;ibutes 
are external to the affective change in 
Code 02.aboVi^, , ^ 

^This categg^ry- includes an those tests in 
which handicj^ped and other special 
youngsters not ordinarily we-ll served by 
a YETP effort are participants. Positive 
change is predicted for the handicapped 
youngster. 



* In spme^cases, these predicted outcomes suggest the services to be offered 
/and the approaches, to evaluating success, i.e., transitibn services may be 
used to increase intrapersonal motivation and then can be evaluated by a 
before-after test of leve^ of aspiration. .However, the^ MBA. classifications 
are* made around the predicted changes and not services'. 



47 ten percent tests, au second approach to data collection involved telephone 
contacts at the y^egional and local site levels* Instruments appropriate^ to 
these activfties-were developed. 

The data from the telephone inquiries were used to finalize selection of 
the sites to be visited bjr the MBA research team, to refine data collection 
instruments for site visits, and to develop comprehensive descriptions of each 
)f the 47 tests! . • v ^ 

Site Visits ' / 

The third approach to data collection for^this study was -the site visit. 
Fourteen sites selected to represent eachs region and type of hypothesis being 
tested were visited by the MBA research team to secure additional descriptive 
?ind qualitative data and to measure other significant program features. 

Four groups of people were interviewed during site visits. These were 
CETA administrators at the prime sponsor level, CETA or YETP administrators at 
the service delivery level, service provider (on-the-job trainer ^r counselor/ 
teacher as appropriate) and service recipients from income-eligible and nonincome- 
eligible groups. 

^ Data Analysis — ^ ^ 

I The analysis of the data generated by all three approaches to collection 

(^^^s ba^ed on a broad *compari son jof MBA findings regarding the status and nature 
of these tests with ten cr*ucial elements generally accepted as standard/essential 
in the conduct of e;^erimental work. These ten were used because they reflected 
DOL's explicit instructions and mandates regarding the mixed income tests. The 
following includes a discussion of the ten crucial elements of a good experim^tal 
design against which the mixed income experiments were measured. 

9 

Clear Hypothesis : One of the critei^ia of a good experiment is the explicit- 
rjess of ibe* hypothesis. The hypothesis is the "if-then" statement on which the ^ 
ijtudy is based^ If income-eligible youth interact with nonincome-eligible youth 
the income-eligible youth will show greater change than they would without the 
interaction. 



• 4 

Operational Variables ; Many interesting concepts in the social/b^viaral 
sciences are nonobservable. For instance, one has to infer the presence of 
motivation from aiperson's behavior. Motivation cannot be observed in isolation 
of 5ome drive-related behavior. Good experiments 'specify observable indicators 
of internal variables. ^ ^ ( 

In addition, experiments should distinguish independent and dependent 
variabtss. ^he' independent variables are those controlled by the e>eperimenter; 
the dependent variables result from changes in th^'independent variables. The 
behavior* of income-el igible'youth (dependent variable) will b^changed by 
mixing them with nonincome-eligible' youth (the" independent variably). Other 
treatments and services applied are also independent variables presumed to 
affect the outcomes or dependent variables.' 

Specific Treatments/Services: It is essential that experiments state 
very clearly what will happen to experimental subjects (and not happen to 
controls), for how long and under what conditicms, Treatments and services 
should not ejnerge or develop during the study. They should be specified bifore 
-^the study begins. In this case, subjects were placed In mixed income groups; 
controls were placed in homogeneous groups. 

Agreement Between Hypothesis, Variables and Trea'tipent/Services : It should 
be appa^rent that these three concepts have to be congruent, each with the- other 
two. If the hypothesis is to mix t? 'increase motivation and motivation is ' 
measured By level of effort associated with task completion itf a group, then a 
y treatment or service that didnot include a mixed group task effort would be 
incongruent with thje hypothesis and outcome variable. ^ 

Subject Selection : The^selection of subjects Should be random to decrease 
the possibility of selecting a totally nonrepresentative group. All key concepts, 
. e.g., income and age, should be carefully verified. / ' 
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FINDINGS 

According to all data available to MBA during the conduct of this 
investigation, 47jmixed incoine experiments were proposed for fiscal years 1978 
and 1979. These 47 tests of the mixed income hypothesis were located i^n 36,. 
prime spon^r sites' in eight regionSf of the United States. Of the .47 tests 
proposed, 29 were actually completed in FY 19^8.; 14 are fn opera tlffni^fv, FY 
1979; and 3 were never implemented^ MBA was unable to o^^l^infonnat^n on;Qg|^ 

An appendix to this report contains detailed case studies and arSlyses «^ 
on a site by site basis. These studi.^&...4re based on data collected during 
either telephone inquiries, site visits or Written reports made available to 
MBA from the prime sponsors. In some cases all three sources of data were 
available to MBA and utijized in the preparation of thesg case studies and 
analyses* Table III-l displays the sources of data by prime sponsor and the 
number df tests for each prime sponsor. . 

A general description of the tests examined in this study of the status * 
and results of mixed tncome exper4inents is presented in Table III-2' Each 
site is lisj:ed, number of tests noted-and summarized, and the type of.test(s) 
indicated. The code for the Type of Tests is located in previously men-; 
tionerfT^ble IM. This "Super Matrix'* is a quick reference iio the 197&and . 
1979 mixed income experiments. y / ^ 



Overview of the Effects of Income Mixing in Youth ^Employment Training Programs 

Table III-3, also\t^he end'of this chapter, presents an overview of 

the effects of inconjlKiTiixing in Youth Employment Training Programs for *all 

tests- conducted in FY 1978 and 1979. This table is based on an analysis ^ 

of all effecti-veness data available to tfle MBA evaluation team though the^e 

data do not necessarily respond to the mix^d income hypothesfs. The effect'ive- 

' ^ j . 

ness ratings applied are positive, negative, no effect and ujiknown. ' " 
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TABLE III-l 
SOURCES OF DATA 



Region 



'Prime. Sponsor 



Number 
of Tests 



6*- 

7 
8 



Data Source 



Written Telephone Site i 
Report Inquiry C Visit 



New York City 
Niagara County 
Steuben County 
Suffolk County 

Northumberland County 
Schuykyll County 
State of West Virginia 
Virginia BOS 

Broward County 
City of Charlotte 
Middle Georgia Consortium 
Tennessee *BOS 

Ann Arbor City 
Tort Wayne ' • 
Indiana BOS k / 
Indiana (SETC) 

Lansing Tri County 
Macon County 
f441waukee County 
Racine, Wisconsin 
Ramsey County 
Rockford Consortium 
St. Paul City 

WOW (Wisconsin Consortium) 

Coastal Bend Consortium 
Ouachita Parish Police Jury 

City of Omaha 
City of Wichita 

Arapfahoe County 
Boulder County 
North Dakota BOS 

California BOS , 
Marin County # 
Monterey County 
San Diego 
States of Nevada 



6 

ERLC 



++ Unable to obtain information 



++ 


++ 


++ 


X 


X 




X 


" X 


X 


) 


X 


X 


X 


X 




X 


X 










. X 


X '-^ 


X 


~ X ■ 


X 

' • X 






X 


^ X 


•X 


X 








X 


X 




X . 


X 
X 




X . 

X 


X 




X 






X ^ 


X 


X 


X . 


X 


X 


X 


X 




X 


X 




X 


X 


X 


X ^ 


X 








X 



X 
X 

X 
X 

X 



X 
X 
X 
X 



Xs^ 



X 
X 



1 1 1-2 



27 



A positive rating means that the implementation of th6 mixed income 

test has positive effects for most of the participants involved, A site 

may receive a positive rating even if all research requirements are not 

met since this rating is based on'^qualitative and/or impressionistic data, ^ 

' / • / 

A negative rating means that the mixed income test had negative 

*■ 

effects for the people involved. I.t may have added so much administrative 
"red-tape" that program managers and youth alike were frustrated in their 
attempts t-9 make the program work. 

A no effect rating is assigned when neither a positive nor a negative 
rating seem appropriate. The mixed income test in these sites apparently 

T. 

had no effect on the relevant people, particularly^ the youth. 

An unknown rating means that data sinply were not available. to MBA to 
N^sign a positive, negative or ^0 effect value. Every effort was mad^e to ^ 
assign a positive or negative value to each site father than utilize the no 
effect or unknown categories. 

Corvfirmation of the Hypothesis 

In general, the results obtained by individual /Sites conducting mixed* 
iy^com^ tests are inconclusive? That is, at this time, taken as an aggregate, 
it is difficult to accept the test hypothesis that mi)^ed income grouping 
(heterogeneous) will Iresult in greater gains for income-eligible youngsters 
than for nonmixed income grouping (homogeneous). On the other hand, it would 
not be completely" accurate to accept the null hyppthesis and assume that the 
grouping pattern made no difference in outcome. 
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For instance, the reader will gather from the case studies, that, in ^ 
most sites, test managers, counselors, participants or all three expressed 
confidence in the mixed income attivity, felt it had made a difference, and 
felt Jhat mixing by incW was more useful than not mixing. These respondents 
told MBA that they observed more rapid change in income-eligible participants 
in^e^mixed groups than in the unmixed groups. The respond^s also told 
MBA that much of this observed change was in the direction of more self- 
confidence, greater career awareness and better job-related skill acquisition. 

Unfortunately, these findings are qualitative rather than quantitative 
and as such are not amenable to structured data^analysis . MBA is reluctant 
to draw any conclusions from qualitative findings such as these. However, 
the trend and the direction of the trend are noted. 

Conduct of Research by Prime Sponsors 

A secondary question to this study on the status and results of mixed 
income experiments for fiscal years 1978 and 1979 is whether aind to what 
extent prime sponsors can independently implement sophisticated and rigorous 
research efforts. Again the findings are mixed and therefore somewhat 
inconclusive. " , ^ 

Some of the sites conducting mixed income experiments in fiscal years 
T978 or 1979 were quite capable of managing subject selection and assignment, 
data collection and appropriate analyses. It is not that others were incapable 
but perhaps too amb^itious in their attempts, 

' 2D 
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still others did not include the required pre- and post-testing of 

participants, a control group or other key elements. The failure to include 

these items may indicate lack of familiarity with the requirements established 

by the Office of Youth Programs rather than lack of ability. 

* ♦ 

The findings at'e mixed and"- cannot be used to accept or reject the 

possibility of implementing rigorous research strategies at the local prime 

sponsor level. The data suggest that, where the research requirements are 

understood, they c^n be implemented, and the research process can be 

effectively^ man aged. . : , 

* 

On a site-by-site, basis, each test is broadly compared to the ten 
crucial elements of an experiment previously discussed in the data collection 
plan. Sites achieved levels of proficiency in these elements at ^rious 
degrees (s^e T^ble II-2). ^ 

% 

Clear Hypothesis : The desired hypothesis was. prescribed by the Office 
of Youth Programs, and the. test sites only needed to state it. However, 
some sites chose to restate the hyp^othesis, and the restatement often- led 
•to a lack of clarity. Distinguishing tests by type is MBA''s attempt to 
categorize *thes^ different hypotheses (*ee Table II-l). 

Operational Variables : Many sites failed to operationalize the 
variables (behaviors or attitudes) that they hoped to see changed in mixed 
income experimentaj subjects. Concepts such as mptivati^rff^titude or 
career awareness were not always linked to clearly measurable behaviors or 
test items. i - ^ 

if * 
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Specific Treatments/Services : Most sites vJ?re able to specify the 
treatment or service program that they provided. 

Agreement Bepeen Hypothesis, 'Variables and Treatment Services : This 



were not usually selected randomly. Furthermore, it is not clear in most 
case^ how incortie was verified and other key characteristics controlled. 



Selection of Control Subjects : As far as MBA could ascertain, control 
subjects were not usually selected randomly. Other key characteristics were . 
not controlled, and it is unclear how income data were verified. 

Internal Validity : Few of the tests were able to confirm internal 
validity because inadequate controls were utilized. 

V » 

External Validity : Few of the tests were able to\:onfirm experimental 
replication. 

' Pretest : Though required by the OYP regulations, some did not use a 
premeasure of key test variables* Some pretests were qualitative rather than 
quantitative, making analysis difficult*^ 




operationalized variables and poorly selected instruments. 



Subject Selection : As far as MBA could ascertain, experimental subjects 
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Post-test T Though required by the OYP regulations, SQme tests did ^ 
not use ^ post-measure of key variables. Some post-tests were qualitativeX 
rather than quantitative., making analysis difficult. 

Status of Fourteen Tests Completed in September of 1979 

Fourteen tests of the mixed income hyjiothesis were conducted in FY 
1979 and Hot completed until September 30, 1979. A follow-up inquiry with 
each of these fourteen tests sites yielded the information presented below. 

Suffolk County^ York : Several attempts to secure information from 
the Suffolk County test administrators were unsuccessful. No status report 
is possible at this time. * ^ 

^ Northumberland County, Pennsylvania : These test administrators 
.conducted a'second^ examination of the mixed income hypothesis in FY 1979 
^6 determine why norvincome eligible youths were not performing as well as 
the income eligible youths. The conclusion reached by this second test is 
that nonincome eff^ible participants do not set performance standards for 
income eligible participant*. They concluded that mixed 'income grouping 
does not affecj^- program performance significantly. 

Virginia Balance-of-State, Bath County, Vifginio : Mixed^ income 
grouping has been rated so highly in Bath County that it has been made a 
regular component of the youth employment training program. However,- this 
te^t still fails^to meet basic reseafch requirements,^ and data are only 
impressionistic and qualitative. 



/ 



Virginia Ba1ance-of-State> Giles Counjby, Virginia : This test provides 
an alternati^'e school experience for youfigsters who cannot function well 
in a regular high school setting and is being continued in FY 1980. FY 
1979 data have not been analyzed, and no final report was available, however, 
program operators rated the test a$ a positive addition to the youth employment 
program « ^ / 

Virginia Balance-of -State, Stafford, Virginia : This program was 
concluded abruptly in July or August of 1979, according to information given 
to MBA. A report was not available at the time of the MBA inquiry. 

Virginia Balance-of -State, Stephens City, Virginia : This test is 
being continued in f:Y 1980 because it meets community needs to help problem 
children and to decrease the school attrition rate. However, no pre- or \ 
post-tests were used, nor are any planned, so a significant data analysis 
is not possible. The program appears to be beneficial to you^h regardlefs 
of their income. 

Middje Georgia Consortium i Several attempts to secure information 



from the Middle Georgia Consortium test admi ni stratoVs^were unsuccessful 
No status report isgpossible at this tjme. * ' 
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Lansing, Michigan ; 'This test of the^ mixed income hypothesis is charac- 
terized by excellent controls and adherence to research requirements. It 
is being continue.d in FY 1980, The results suggest that mixed income grouping 
positively affects income eligible youths, * ' ^ ' 

Indiana Balance- of-S t ate, Columbug, . Indiana : This test yiel^d many 




positive results in terms of administration and community support. However, 
when the results of this test were tallied, there , was no significaryt difference 
observed between participants in control and experimental groups, 

Indiana State Employment and Training Council, New Castle, Indiana : 
Final reports have not teen, made available. No conclusions are possible at 
this time, 

' St, Paul, Minnesota* ': St, Paul test administrators did not adhere to 
all research requirements. The available results showed, however, no significant 
difference 'between experimental t)r control subjects. Program completion rates, 
educational' attainment ar^ the like are measures used for comparison, 

- • Trico-CETA Consortium, Silver Lake, Wisconsin : Several attempts to 

secure information were unsuccessful. No status report is pos.sible at^this 

time. . ^ • 4 ^ 

• * 

r North Dakota 3alance-of-State?^ This test of the^mixed income hypothesis 



did not have enough subjects to yield meaningful findings. No pre- or post- 



tests v^re ysed, and the program only ran t'brief period; 



TABLE HI -2 



.BRIEF DESCRIPTIONS OF THE 47 MIXED INCOME TESTS 
FY 197Q and 1979 • 

"The- Super Matrix" 1 , 

Region 2 f 



Prilw Sponsor 


Test Site 


Type of Test 


' ^ 

Dates of Operation 


> Summary of Test 


7 

CoMpleted Nixed Income Tests 
1. Niagara County, NY 


9 

\ 

Niagara ^County Conmunlty 
College 


04 


July 24,^978 to 
September 15, 1978 


'J ■ • 

A nuifber 6f specialized services were provided for, 
physically handicapped youth In a mixed Income envlroh* 
went. The*f1nd1[jngs were fairly Inconclusive because data 
collection strategies were not specified. 


1. Steuben County,' NY 


Boafd of "^Cooperative Educa- 
tional Service; .(BOCES) . 
Wlldwood Career Center 

9 


01 


February to June . 
1978 ^ 


* • 

Alternative education experiences and exposure to the 
world of work were the services m1xed4ncppe test sub* 
Ject% and controls received In Steuben Qomt%4 New York* 
A follow-up completed one year later suggests a lower 
than average dropout r4tc implying mat rnixeo gniuping 
has some t|enef1t for participants. 


3. Suffolk County, NY 
f 

/ 


? ' 

Suffolk C6unty, 'NY 


01 


February to Septem^ 
ber 1978 


Several variations were used to explore best mix In term 
of grouping of participants, experiences provided and 
wjiopc nff^t^d nut*of-school vouth received Job exDeri* 
oftce. Nixed Income groups did not fare better than 
nonmlxedS higher wage group had better program outcomes. 


Operating Nixed Income Tests' 
4> 'Suffolk Coiinty. NY 

I 


—5 — : 

•V 

Q 

Suffolk' County., NY 


01 


November 1978 to 
Septejnber 1979. 


This Is essentially the same as the test conducted by 
^ this prime sponsor In FY 1978. The number of control 
subjects has been Increased to allow greater analysis. 


No Information Available 
5. New York City. NY 




. Jonknown / 

^ ft / 


' • ■ / — — 

Unknown 

0 * 


'> e » ' 

• Insufficient Infonnatlon available. 

7? « . 
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TABLE 1 1 1-2 (Continued) 



' BRIEFDESCRIPTIONS of the 47 MIXED INCOME TESTS 
FY 1978 and 1979 
"The-*tfper Matrix" * ^ 

Region "3 

» 

> 



Prim Sponsor 


Test Site 


Type of Test 


Dates of Operation 


SuMMry of Tost 


Coa^leted Mixed Incoue Tests 










Morthuflriierl Aftd. ^ 
Pennsylvania 


^rt(ortlUMt)€rland County* 
Pennsylvania 


01 


January 16, 1978 to 
Septeinbei^ 30, 
1978 

/ 


Classroom training and work experience were conblned 
with career counseling In this iHxed IncoMe test. 
Participants were exposed to three occupational 
cate^forles In nlx^d pairs of tncb«e-el1g1ble and 
nonlncome-ellglble youth, ftel&ults for first year 
showed Incone-el foible youngsters perfomdng better 
than nonlncoMe-eliglblt youngsters. ^ 

/ ' 


2, Virginia B0$ .^-^ 


Prince Gcorue's County 


* • 03 


June 12, 1978 th^ 
Septen<>er 9, 1978 


A sdiner work experience was provided Incoae-ollglble 
and^nonlncoM-ellglble youngsters. However, no data 

Mere collected on' a pre- or postHusIs on which to , 
^develop any conclusions. 

^ * { 


3. Virginia BOS--^, • 


Virginia Employment 
Coonlsslon 


01 

T 


January to <nme 
1978 


This test was essentially a pAograa to expoi^y&ung- 
sters of all Income levels to the world of work. 
Convocations and workshops were held at area high 
schools. No data were collected.' 


4. West Virginia -^OS 

' \ 


Wheeling. West Virginia 
(West Virginia Northern 
Conimmlty College) 


03 

\ 


March 1» 1978 to 
September 30, 
197C 


^Thls program provided out-of-school youth with skilled 
training In major appliance repair on the cam|S/of 
the local coawunlty college. Pre- and post-testing 
arid three follj»*-ups were key. approaches to daU ' 
collection. Income-eligible youth perforned better 
than nonln^ae-ellQlble youth In either the wl^^ed 
, or nonwixed group. The follow-up Is continuing on 
these subjects. ^ > 


(^ratlnq Mixed Income Jests 

5. Nortiiuniberland County t 
Pennsylvania 


* 

Northufhblrland County, 
Pennsylvania 


01 


October 1, 1978 to 
Septei!t)er 30, 
1979 


t ^. 

Because results from first year's test showed Incoiwe 
eligible youth performing better than the nonlncome 
ellgitle, Northumberland County Is running another 
test now to determine causes for this difference. 
They have strengthened their measurement techniques 
In this Second study. ' ^ 



T 
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TABLE 1 1 1-2 (Continued) 

BI«EF DESCRIPTIONS OF THE 47. MIXED INCOME TESTS 
FY 1978 and 1979 
"The Super Matrix" / 
Region 3 (Continued) 



I 



6. Virginia SOS 



7. Virginia BOS 



8. Vtrginia BOS^ 



9. Virginia BOS 




Ttst Site 



Bath County. Virginia 



Giles County. Virginia 



Stafford, Virginia 



Stephens City. Virginia 



Type of Test 



02 



02, 03 



02, 03 



, 01 



Dates of Operation 



February 1978 to 
Septefr4)cr 1979 



October 1978 to 
Septefi*>er 1979 



October 1978 to 
Septefifcer 1979 



October 1, 1973 to 
Septenber 30, 1979 



SMary tf Tcil 



This Kort-stuOy program Is deslgntd to provide poten- 
tial school dropouts with, a viable alternative to 
traditional classrooa Instmctloii. fj^lclpantt 
receive classroom tralfiljm In Adult im Skills 
the pmrise that these skills can 
Internal or affective co~nt$. ^^Jj* JV* ™^ 
of this exposure to wrvlval sMlls, pmicl^ 
expected to de^lop mre Independetict. and WWlMl- 
iSf. Positive changes have been obtemd thOM^ there 
are no systematic date available. 



9m alternative to typical school Inslmctton It 
provided 30 participants In the "PATS" (Pesltlvt 
Approach to School) progrwa. Eight of the thirty 
are Inoow eligible; eight are nonlncow ellalble; 
fourteen are control subject*. Progress Is based 
on Physical appearwice, test scores and job relattd 
behaVlors. Incowe-ellglblt youth In the arfned 
setting appear to be progressing better than yoiitb 
In the nowiHxed settlM. Dite are very Inconclvslvt 
at thl^ t1a«. hoi^verTboMuse the tMt Is still 
operating* 



/Wi In-school iior*.study program Jf^^^^f^^ 
the local school board. Nfithertestlng nor rt««^ 
Ing Mre performed. Honever, there •t|;lr;tlo 

of student to supervisor, •"^ •J^^'^ESilT?-. 
made at frequent Intervals, ^ults are Inconclusive 
becauie test Is still In operation. 



Income eligible and nonlncome ellflbles ■ 
iSStridltlSnal vocatlonalschool JJ^^JL^i^J* ^ 
of the mixed Income hypothesis. ^ •^Jjjf *:!f!5!, 
Sere not u$e<!; however, the observation from personnel 
«lScl2tedw1th the test Is that the mixino Isnot 



associatea wiwi w»» •* •"t . — : — * r i 
"using any difference In UHt^h«»lor of Wo 
cliijible subject^. 
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' TABLE 1 1 1-2 (Continued) 

BRIEF DESCRIPTIONS OF THE 47 MIXED INCOME TESTS 
FY 1978 and 1979 
"The Super Matrix" 
Region 3 (Continued) 



Prlne Sponsor 


Test Site 


Type of Test 


Dates of Operation. 


Suvmary of Test 


. Tests Proposed But Never 
Iboleoented 

10, SchMykyll, Pennsylvania 


Schuykyll -Carbon County, 
Pennsylvania 


01 


Not Applicable 


This test .had been proposed tb <|8f^er on-the-job 
training to mixed income pairs. r 



I 

Ca; 



V7 
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TABLE 1 1 1-2 (Continued) 

BlUEF DCSCRIPTIONS OF THE 47 MIXED INCOME TESTS 
FY 1978 and 1979 
"The Super Matrix" 
Region A 





frim Sponsor 


* Test S1t« 


Type of Test 


Dates of Operation 


StfMiry of Test 




Comleted Hlxed Incoae Tests 










z 


1. BroMard County, Florida 


Broward County, Florida 


01 


March 1, 1978 to 
September 30, 1978 
1978 


Youth apprenticeship tralnfrig In retail sales ms 
paired mIUi guided group Interaction. MultlvaHiK 
analyses were calculated and yielded no stitlstieaify 
slgr^lflcant differences based on participant groupings. 




Z. Tennessee 80$ 


Upper Cumberland, 
Tennessee 


01 


July to Septester 
30, 1978 


This sunner program consisted of a variety of norfc 
experiences for out*bf*school youth. Pre* and post- 
data were collected and analyzed, but these data 
yielded no statistical significance. 


• 


i 

Operating Mined Incoae Tests 








t 




3. Kiddle Georoia Consortim 


Rnbbins Air Force Base 
Macon, Georgia 


01, 03 


January 1978 to 
September 30, 
1979 


An Aerospace Careers and Exploration Frogran Is being 
conducted at ttie Robblns Air Force Base fn Middle 
Georgia. This test started In FY 1978 and Mill con- 
elude In FY 1979 providing skilled training and 
counseling to out-of-school youth. Data are Incon- 
clusive at this time. 




Tests Proposed But Never 
ttnpleinented 

4. Charlotte, North Carolina 

4 


Charlotte, North Carolina 


01 


^ Not Applicable 


This program proposed to offer transition services 
only to mixed income subjects. The job placenent 
rates of the mixed incone group subjects trauld have 
been compared to those of the nonmlxed groups. 
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TABLE III-2 (Continued) , ■ 

BRIEF DESCRIPTIONS OF THE 47 MIXED INCOME TESTS ' , 
FY 1978 and 1979 

"The Super Matrix" * , 

Region 5 





I 

PriM Sponsor 


-> 

Test Site ^ 


Type of Test 


Dates of Operation 


Smary of Test 




Coopleted Klxed Inaxae Tests 












1. Ann Arbor* Michigan 


Ann ArMf, Michigan 


04 


January to June 15, 
1978 


Five school sites'ln Ann Arbor were used to conduct 
this mixed Income test with handicapped youth. Youth 
were not paired by Income in Job settings, but. they 
did Interact In the claswHW, Results were that the 
handicapped youngster does benefit from such a program. 


l-III 


2. Fort Wayne, Indiana ' 


Fort Uayne, Indiana 




January to June 
1978 


ThIs'ln-schooV program for high school seniors was 
designed to provide work-study opportunities for the 
hard-to-place student regardless of family Income. 
The hard-to-place are usually physically or emotion-'^ 
ally ^landl capped. Results were nonsignificant based ^ 
on statistical analyses. 


en 


3* Indiana, BOS 


Columbus, Indiana 


01 


(larch 1, 1978 to 
June 30, 1978 


Transition services were, provided to nllxed Income 
subjects* No conclusive data are available. 


1 


4« Lansing, Michigan 
• 

r * 


Lansing, Michigan 


QJ 


January to 
Septefnber 1^78 


Work experience and classroom training were key 
services delivered to subjects In this mixed Income 
test. Subjects were mljwtflit Job sites and in class- 
rooms.' The results aft6 that control subjects (those 
not mixed) scored higher than the experimental subjects 
on pre- and post test measures of attitude, motivation, 
and tiie like. However, the experimental subjects 
showed pore significant change In score from the pre- 
to the pos|;^t. 

! 

« 
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TACLE 1 1 1-2 



(Continued)* 



BRIEF-DESCRIPTIONS OF THE, 47' MIXED INCOIIE TESTS^" 
FY 1978 and 1979 * - 
"The Super Matrix" 
.- ' Region 5 (ContinuecQ, 



Prist Sponsor 


^ Test Site 


Type of Test 


Dates of Operation 


T= / 1 

^ Sunmry of Ttjt ^ 


5. i^Con County* Illinois 


Decatur, Illinois ^ ^ 


.01 


January to June 
1978 


Potential dropouts were identified and enrolled in a 
work -study pronram. Participants w^ H and 15 years 
old and mixed In groups by Jncoroe, Results are ^ ^ 
inconclusive. 


6. Milwaukee, Wisconsin 

« / 


University oT Milwaukee * 
' (School of Allied Health 
Professionals) 


.03 


April to September 
1978 


Participants received university- based Instruction In 
the various allied he^ltK fields. This Instruction 
was designed to deliver MrfceUble skills. A very 
high attrition rate affected the conclusiveness of the 
findings from this nixed IntOM te»t. 


7. TRICO-CETA Consort i«i 
ft^rin# Wisconsin 

i 


Kenosha, Wisconsin 


01 . 


January to June 
1978 / 


In*schoo1 youngster^ fron^lncone-ellglble and nonlncow* 
eligible families were nixed In an urban work-study 
program. Income-eligible youth seemed to Improve 

^ter than nonlncome ellgibles regardless of groupings. 


-8. Raftisey Count^, Minnesota 


Maplewood, Minnesota 


04 


Unknown 

•\ 


This test was.desttin^d to serve handicapped youngsters 
through counseling, drt-the-job training and job place- 
ment. The test was discontinued shortly after it 
started, and there^are no data. 


9. Rock ford Consortium 

c 


Harlam Board'.of Education, 
Illinois 




March 15 to June 15, 
1978 


In-school youth participated in a work-study program. - 
Pre- and post-measures were collected.^ Results have 

IIUv UCCIl «llalj*CU. • 


t. 

to. WOW Consortium 

/ 


Waukesha, Wisconsin 


^ s — 

^ 04 


J^liry^to June 
1978 


Handicapped youngsters at two sites were given a work- 
stu(<y experlencGT In a mixed Income setting. Theie 
subjects were cofnpared to participants in Title I 
programs and the mixed income subjects showed more 
satisfactory performance. 

/ 


Operatlnn Uixed lnco.»ie/F€Sts 
Ih^Lansing, Michigan 

> 


Lapsing, Michigan 


01 


Ottol^r 1, 1978 to 
Septenber 30, , 
1979 


This Is a replication of the test conducted by Lansing 
in FY 1978. No data are avail^bl^ 
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TASLE III<t2 (Continued) 

BRIEF DESCRIPTIONS 0^ THE" 47 MIXER INCOME TESTS 
FY 1973 and 1979 
—f "The Super Matrix'* 
Re.gion 5 '(Continued) 



4 . 



>rlM SfOfisor' 


^ Test Site- 


1 ^ 

Type of Test 


Dates of Operation 


'Sumry of Test 


12. Indiana BOS 


Co1uiii>us» Indiana ' 


04 


May J, 1978 to 
Septeni>er 30, ^ 
1979 


An alternative school program Is offered pregnant 
women In this mixed Income tes^. No daU are . 
available. 


13. Indiana State Eii|>1oyment 
^ ^ and Training Council 


New Castle, Indiana 

Blue River Valley School^ 
^ Corporation 

\. . 


% 
03 


Junei978 to 
Septe(it>er 1979 


This In-school test Involves kxK exanHnatlon of 120 
variables from the basic demographic to atMtudes and ' 
levels of motivation. A major emphasis the class* 
room and on-the-job' work Is on the acquisition of 
marketable skills, fk) conclusive data are available 
now. 


14. Indiana State Ei^>1oyiiient 
. and Training Council 


Hanaony School 


03 


April 1978' to 
April 1979 


Emphasis Is placcfd on Improved academic performance of 
mixed Income participants who are In an alternative 
School setting. Data analyses have not been completed. 


15. jSt. Paul, Minnesota 

* * * 


St. Paul • Minnesota , 


01 


January 1078 to 
September 1979 


Part-time euployment Is provided as an Incentive to 
remaining In ichool to mixed -Income $ii>ject$. All ^ 
participants must be^ursulng a high school diploma 
or Its equivalent to remain active. OaU were npt 
systematically collected, and/lndlngs are Inconctuslve 


16.' Tr1co-C£TA Consort luij"^* 
Radne, Wisconsin 

Q 

• * « 


Silver Lake^ Wisconsin) 

% 




October 1978 to 
September 1979^ 


This Is a replication of the FY 1978 tesV»<c«Pt that 
IVis conducted In a rural setting. No da|| are avail- 
able. 
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TABLE 1 1 1-2 (Continued) 

BRIEF DESCRIPTIONS OF THE 47 MIXED INC0>1E TESTS 
FY 1978 and 1979 
"The Super, Matrix" 
Region 6 



Prim Sponsor 


Test Site 


Typ^ of Test 


Dates of Operation 


Sumry of Test 


Coa)1eted Hixed IncottlTests 


Corpus Chrlsti » Texas 


. 01 


March to Septeni>er 
1978 


This dropout prevention program was b^sed In^two 
schools. The first school was a traditional Insti- 
tution; the second was an allematlve setting. No 
post-test was used, so findings are Ihconcluslve. 
Change was observed In dress and attitude of partici- 
pating youth. 


1. CoisUl Bend Consortium 


2^ Ouichl^ Parish Police 
Jury 


Ouachita Parish* Louisiana 


* 01 


February to August 
1978 


This work st;u(ly progranr-Mwd to provide a . part-tine 
job placer.jent for each participant. No pre- or post- 
tests were used, but test personnel reported no 
differences In behavior In nixed or nonnlxed groups. 
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TABLE III-2 (Continued) . 

BRIEF DESCRIPTIONS OF. THE 47 MIXED INCOME TESTS 
FY 1978 and 1979 ' 
N "The Super Matrix"' 

Region 7 



Prim Sponsor 


Jest Site 


Type of Test 


Dates of Operation 


Suwary of Tttt 


C(Mp1eted Hlxed lnco«e Tests 
1. OMh«. Nebraska 


Omaha, Nebraska 




January to Auaust 

.1978 ' ^ 


This career exposure progran, mhaged by the Girls 
Club of 6iiaha. Included counseling, guided group 
Interaction, and on-the-job training. Participants 
were all fen»le. Pre- and post- Pleasures were used 
but were still being analyzed at the tiM of this 
report. Results will be available at a later tine. 


Tests Proposed But Never 
lupleoented 

Z. Ulchlu, Kansas 


Wichita, Kansas * 


04 


Not Applicable 


Wichita had proposed an In-school progran focjhandl- 
capped youngsters, fiscal problem prevented Its 
Implementation. 



. TABLE 1 1 1-2 (Continued) 
BRIEF DESCRIPTIONS OF TflE 47 MIXED INCOME TESTS 



FY 1978 and 1979 . . ^ 

"The Super Matrix" 
Regi on 0 



Prim Sponsor 


Test Site 


Type of Test 


' Dates of Operation 


SuMMry of Test 


Coinpleted Mixed Income Tests 
1. Arapahoe CounCTt Colorado 


Arapahoe County t Colorado 

> 




January to 
Septenter 30 » 1073 


Nn nr0* nr DA^t-tPci^ wfii*# actnlnlstered to prooram 
participants, so results are all speculative. There 
seemed to be a tendency ^or participants In the 
mixed Income group to have more positive attitudes 
at termination from this vrark-studly. In-school approach 
to the mixed Income experiment. 

» 


2, Boulder County. Colorado 


Boulder^County* Colorado 


04 


* January to Septenter 
1978 


Handicapped and rural youth were placed In tlorfc 
experience situations and' also received Intensive 
one-to-one counseling In this test of the mixed 
income nypoinesis. wniie mere was no »y»iciw«vit 
ttesting or data collection. It was reported that this 
program filled a local need in exposing employers to 
the employablllty of handicapped and/or rural youth. 


Operating] Hlxed Income Tests ^ 
3. North Dakota BOS 

4 * 


^\ ^ ■ 

Four R^ra/I Comnmnltles 
• 


01 


February to 
September 30, 1979 


Participants In four rural sites are Involved In 
coimjunlty Improvement projects. Ho pretests were 
used; post- tests are not planned. There are no 
results to reports 
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TADLE 1 1 1-2 (Continued) 

ORIEF DESCRIPTIONS OF THE 47 MIXED INCOME TESTS 
FY 1978 and 1979 • 
"The Super Matrix" 
Refjion 9 



Mat Sponsor 


Test Site 


Type of Test 


Dates of Operation 


SuHMry of Test 


CoMple^d ^Hxed Incoae Tests 
1. Callfbmla, BOS 


Placer County 


01 


February to 
Septefnber 1978 

- i ^ 


A variety of work experiences were provided In-school 
youth from six area high schools. Pre-tond post- 
measures were used* and these data yielded no slgnlfl-^ 
cant differences In attitude or mtlvatlon resulting 
from "^"9 Income. ^ 


2. Nirin Cointy, California 


Corte ^Udera* California 


02.«^03 


June to 

Septen<>er 1S» 
1978 


Mixed Income subjects were engaged In a variety of 
counseling, educational and «kreat1ona1 activities 
during the test period In addition to a woHc assign- 
.fnent. Cmpliasls was placed on Internal and external 
change. This test generated highly usable date, 
but there was no statistical significance observed. , 


3. Monterey County, 
California 


Salinas, California 
• 




March to 
Septen<)er 1978 


This program Was geared toward potential school drop- 
outs and paired woHL^ftfperlences with acinic 
Instruction. The r^lts were stetlstlcally Insig- 
nificant. 


4. Nevada BOS 


Carson City. Nevada 
/ 


01 


January 
June 1978 


An alternative vocational education program was the 
main service provided te mixed income sti>Jects 1^ 
Carson City. It Included counseling and work experi- 
ence. However, no conclusive results can be presented.. 


5. San Diego, California 

' =r^ 


San Olego, California 


01 


January to June 
1978 ^ 


Thi-s In-school program had two to three months of 
work experience for each ,i)art1c1pant. Pre- and post- 
tests were used, but 1nteract1on,l>^tween th^ incof.« 
ellgibles and the nonlncome ellglgles was almost absent. 
Tlict results ire highly Inconclusive. 
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TABLE III-3 

OVERVIEW OF THE EF^TS OF INCOME MIXING IN YOUTH EMPLOYMENT TRAINING PROGRAMS ' 

Region 2 * * 





Prime Sponsor 


Test Site 


Rating* 


Comment 




K Niagara County, N.t. 


Niagara County 
Community College 


+ 


This rating is based on observed increases 
in self-confidence. No systematic ^ata are 
available. 


1 


2. Steuben County, N.Y. 


Board of Cooperative 
Educational Services 
(BOCES) Wildwood 
Career Center 


+ 

* 


Dropout rate lower for test participants 
based on follow-up study, 

f 


3. Suffolk County, N.Y. 


Suffolk County, N.Y. 

- 


0 

• 


An participants performed about the same, 

f 




Operating Mixed Income Tests 


\ 








4. oUTTOiK Lounty, H . I . . 




, UK 


Nn fnllnw-un information available-. 




No Information Available 
5. New York City, N.Y, 


* 


uk 


Insufficient information available. 

o 













ERXC * + = positive 0 = no effect - . 

an— - = negative uk = unknown - J ■ • ' ' . ^ 

: : - — - - — 



■ . TABLE III-3(Continued) ^ 
OVERVIEW OF THE EFFECTS OF INCOME MIXING IN YOlfTH EMPLOYMENT TR)\INING PROGRAMS 

Region 3 



I 

ro 



Prime Sponsor 



Northumberland, 
Pennsylvania 



2. Virginia BOS 



Jest S 



Northumberland County, 
Pennsylvania 



Prince George's 
County 



Rating^ 



Comment 



'{ncome eligible participants fared well though 
it is not clear this finding is related to mixed 
income grouping. 



Good interaction produced, and students Were 
exposed to the world of work. However, no 
systematic data are available. , , 



3. Virginia BOS 



Virginia Employment 
Commission 



uk 



No d£tta or "guesses" are available. 



4- 



-West Virginia BOS. 



Wheeling, West 
Virginia (West 
Virginia Northern 
Community College) 



Income el igible -participants fared well thougti 
it is not clear why. > " . 



5. Northumberland County, 
Pennsylvania 



Northumberland County, 
Pennsylvania 



This second' test in Northumberland County led 
to the conclusion that mixfedMncome grouping 
had- no effect on"income eligible participants. 



ERIC 



8 positive 
« neqatlve- 



0 = no effect 
uk s 'unknown 
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TABU 1 1 1-3 (Continued) « ^ 

OVERVIEW OF THE EFFECTS OF INCOME MIXING IN YOUTH EMPLOYMENT TRAINING PROGRAMS 

Region 3 (Continued) 



Prime Sponsor 



6, Virginia BOS 



Test Site 



Bath County, Virginia 



^ting* 



Comnie 



ntC 



Self-QQjifidence appears to increase as a result 
of 4)rGgram involvement-. 



7, Virginia BOS 



Giles County, Virginia 



\ - : T 

/The trend suggests that mixing helps increase 
the performancsB of the income eligible* 



I 



8. Virginia BOS 



9- Virginia BOS 



S^tafford, Virginia 



uk*. 



The program ended abruptly, and no report has 
been made available to MBA* » 



Stephens City, 
Virginia 



This rating is. based on observational data 
only.^ ^ / 



10. Schuykyll, Pennsylvania 



Sghuykyll-Carbon . , 
County, Pennsylvania 



uk 



Test never implemented. 



84 



rn^r- * ' positive 0 = no effect 

EfyV - ° negative uk = nnknnwn 



TABLE I I 1-3 ( Continued) - 
OVERVIEW OF THE EF^CTS OF IKCOME MIXING IN YOUTH EMPLOYMENT TRAINING PROGRAMS 

Region 4 



Prime Soonsor 
' 1 Broward County* Florida 

\ 

^-y^ 


Test- Site 

Brbward County, 
Florida 

• 


Rating" 
0 


Various analyses yielded no significant differ- 
ences in performance based on participant 
groupings. 


2. Tennessee BOS 

* * 


Upper Cumberland, 
Tennessee^ 


0 


■■ : — ""^ ^ 

Analyses of data yielded no^ignifii^t differ- 
onroc h;«cpri nn rfrnunlna^ of Darticioants . 


3. Middle Georgia 
Lonsor 1 1 uni 


Robbins* Air Force 
Base Macon, Georgia 


uk 


< 

No follow-up^ information available. 

■ . • ^ . • r 


4.- Charlotte, North Carolina 


Charlotte, North 
Carolina 


uk 


Vjest never implemented. 



I 

ro 

MX 



. *-+ = positive 
- = negative 
, 0 = no effect 
^ " uk = unknown 



/ 



^ 6G 
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' --^^ TABLE 1 11-3 (Continued) 
OVERVIEW OF THE EFFECTS OF INCOftE MIXING IN YOUTH EMPLOYMENT TRAINING PROGRAMS 

Region 5 



I 



Prime Satfhsor 



Ann Arbi>c» 



Michigan 



2. Fort Wayne, Indiana 



3: Indiana, BOS 



Test Site 



Ann Arbor, Michigan 



Fort Wayne, Indiana 



ColumtHis, Indiana 



Rating^ 



Comment 



uk 



The handicapped youngster seems to benefit 
from such a program. 



Analyses of data yielded, ncrsignificant differ-^ 
ences based on groupings of ^jirti^i pants. 



No data or "guesses" are. available. 



4. Lansing, Michigan 



Lansing, Michigan 



In come_ eliqible youngsters seemed to fare well 
,inThiTnpV^ogram. ' * , \ 




,5. Macon County, Illinois 



-Decatur, Illinois 



/ 



The trend suggests that mixing helps .increase 
the performance of the income eligible. 



67 



O * ♦ a positive 0 = no effect 
ERJC - * negative uk = unknown 



* TABLE 111-3, (Continued) 
OVERVIEW OF THE EFFECTS OF INCOME^MIXING IN YOUTH EMPLOYMENT TRAINING PROGRAMS 

Region 5 (Continued) 



Prime Sponsor 
6. Milwaukee, Wisconsin 


Test Site 

Untversity of . 
Milwaukee^ (School of 
Allied Health 
Professionals. 


0 : „ 


TKe high attrition rai£. seems to have impacted 
on the performance^'ofall participants. 


7. TRrCOrCETA Consortium 
Racine, Wisconsin 


Kenosha, Wisconsin 
* 




' The trend .suggests that the income eligible 
subjecfts do well in any group. 

\ 


8. Ramsey County, Minnesota 


Maplewood, Minnesota 
• 


c 

uk 


Test discontinued shortly after it started. 

r 


9. Rockford. Consortium 

c 


Harlam Boar^f 
Education, Illinois 


uk 


Available data have never been analyzed by 
test administrators. 


' 10. wow Consortium 
—a^ 


Waukesha, Wisconsin 
« 


+ 


More positive cha\e noted in , mixed irrcpme 
groups than in nonmixed groups. — 

* 



* + =5 positive 0 = no effect 

- = neqative^" uk = unlrnnwn 



'0 



TABLE III-3 (Continued) 
OVERVIEW OF THE EFFECTS OF INCOME MIXING IN YOUTH EMPLOYMENT TRAINING PROGRAMS' 

Region 5 (Continued) \^ 



Prime Sponsor 



,11 . Lansing, Michigan 



12. Indiana BOS 



Test Site 



Lansing, Michigan 



Columbus, Indiana 



/ 



New Castle, Indiana 
Blue River Valley 
School Corporation 



Rating* 



Comment 



Income eligible youngsters seemed to fare well 
i^^is program. ^ 

% i 



No significant differences were observed in 
the performance of experimental or control 
subjects. 



13. Indiana State 
Employment and 
. Training Counci 1 



uk 



Data have not been analyzed. 



14. Indiana. State 

Employment and 
Training Council 



Harmony School 



uk 



Data analyses have-not been completed. 



( 



15. St. Paul, Minnesota 



7:. ' 



St. Paul , Minnesota 



uk 



Pata were not systematically collected nor 
analyzed. ^ ' » 



« positive 



\0 = no effect 



J- 



TABLE I I 1-3 



OVERVIEW OF THE EFFECTS OF INCOME MIXING IN YOUTH EMPLOYMENT TRAINING PROGRAMS 

Region 5 (Continued) ■ i 



Priwe Sponsor 



^16. TRICO-CETA Consortium 
Racine, Wisconsin 



Test Site 



Silver fake, Wisconsin 



Rating^ 



Coimient 



uk 



.... . y ^ 

The trend suggests that the income eligible 
subjects do well in any setting. However, no 
follTow-up data'were availahJe to support the 
trend' 



* + = positive 
- = negative 
0 ='no effect 
uk = unknown 
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(able III-.3 (Continued) 
OVERVIEW OF THE EFFECTS\.OF INCOME MIXING IN YOUTH EMPLOYMENT TRAINING PROGRAMS 

Region 6 



i 



PrlM Soonsor 


test Site 


Rating* 


Comment 


1. Coastal Bend Consortium 


Corpus Chrlsti, Texas 


. + 


Participants did improve in attitude and dress, 

• 

> 


— ^ 

o Ouachita Parish Police 
Jury 


Ouachita Parish. 
Louisiana 




Nn dnn'lf'lrant Hiffprpncpc w'prp^ obsprvpH in thp 

performance of experimental or control subjects. 


1 ■ ■ 

* + = positive 
- = negative 
0 = no effect 
uk ^ unknovm 
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TABLE IU-3 (Continued) 
OVERVIPI OF THE EFFECTS OF INCOME MIXING IN Y(56tH EMPLOYMENT TRAINING PROGRAMS 
' ' Region 7 , 



PHne Soonsor Test Site Rating* Comment 


1. Omaha, Nebraska 

V 

— ^ : 


Oaiahd> Nebraska 


+ 


Career aspirations did Increase for Incom 
eligible subjects, 

\ 


2. Wichita, Kansas 


Wichita, Kansas 

> • 


uk 


Test never Implemented. 



* positive 

- = negative 

0 = no effect 

uk =^ unknown 



0 
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TABLE III-3 (Continued*) 



overv]ew of the effects of income mixing in youth employment training programs 



Region 8 



Prime Sponsor 



1 ; Arapahoe Cpunty, 
Colorado 



Test Site 



Arapahoe County, 
Colorado 



Rating* 



Comment 



[ — ^ ^ 

Income eligible participants fared well though 
it is not clear why. 



2. Boulder County, 
Colorado 



Boulder County,/ 
. Colorado^ 



This program filled a local need, to assist 
handicapped youth. 



.3. North Dakota BOS 



Four Rural Comqiunities 



uk 



No! tests were administered, and sample sizes 
were tod small to even "guess". 



* + = positive 

- = negative 

0 = no effect 

uk - unknown 



so 



CHAPTER IV 
THE STATE OF THE ART 



This chapter is an assessment of the state of the art with respect to 
mixed income testing at the Total prime sponsor Tevel . MBA's approach- to a 
state of the art includes not only an assessment of an overall performance 
level but' reasons for that performance level as well. Chapter V of this 
.document lists some specific recommendations for future mixed income tests 
which build on the state of the art described here. 

The general state of the art of mixed income testing at the local pritne 
sponsor level is very developmental and primitive. In two years of ^testing 
the mixed income hypothesis, results are still highly specula>TVe and 
nonconclusive. Prime sponsors adhere to the requiretfients cff the test with 
varying degrees of proficiency. Reports and data analyses were oftennot 
useful. There is no developing body of knowledge for reference that will 
document the relative effectiveness of one approach over another. There are 
no new questions emerging suggesting alternative tests and hypotheses. For 
these and other deficiencies MBA concludes that the state of the art Is only 
beginning. 



Htowever, it is MBA's contention that a worthwhile process 'has been 
started that can be augmented to enhance the overall effort and advance the 
state ofHhe art. Some of the reasons that the state of the art is primitive 
after\two years are noted below. 



Failure of Test Sites to .Follow Directions 

In far too many cases, test sites did not adhere tor specif fr requirements 
established for the mi;<ed income test. Some of these n«fquirements includ'^^hB 
use of pre- and post-testing, the use of control groujs ^ and the mixing of 
experimental subjects by iV)come. MBA has concluded that man^ did not understand 
the conceptual nature' of, the mixed income test, nor did they understand the 
importance of sli^ardized data collection. The state of the art can be improved 
if sites more adec^uately adhere to the experimental directives established by 
the Office of Youth Programs. 

IC ■ • ' 81 , < , 



Variables of Interest Not OperaJ^onali^ 

Some sites appropriate ly ch ose to specify the attHtutes that they 
hoped' to see chang^ as a result^of the mixed income interaction. However,, 
few^ites specified variables in operational or measurable terms. It is # 
almost impossible to assess the qualitative changes, predicted when thOse changes 
are not '^de scribed in measurable terms. ^ 



Very Small Numbers of Subjects 

One of the reasons that the results are inconclusive is that they are 
* • <- 

based on very small samples. In some cases 10 experimental subjects were 

compared to 100 control subjects. There i^ no ma^gic number, but any sample 

size needs -to be sufficiently large enough to account for attrition and perform 

meaningful data analyses. 

V 

Inappropriate^ Data Collection Strategies 

Those sites that did imp^lement pre- and^ost-testing often^ e)^ercised 
very little control over th^ data collection process. Systematic testing and 
data analysiTdTd not characteri-ze most of the projects conducting mixed^income 
experiments. 



Inappropriate or Inadequate Test Instruments . 

^ *«Sites seemed to select test instrument? in a haphazard method. The 
instruments sometimes were inappropriate or inadequate for the taslj at h^nd. 
Furthermore, very little ^comparison could be m^ade from 'one test, site to 
pother because each site selected its owa measurement tools. . ^ 



Inadequate Program Length . • ' ,r 

^ Many of these tests were in operation for' only three to six months. . / 

This is probabTy not enough time to produce the kinds of effects^'exgected . . 
frorp mixed income grouping. ' . ^ , 

- Insufficient Follow-up • ' ' " ^' * ' 

Finally, MBA found almost no systematic follow-up of mixed income test 
subiects after the test was completed. Wfiateven effect. mixed income groypin^ 
produced cannot 'be documented to be long lasting or have>a-rry-over into other 

.' ' " " ' ' iv-2 ''82 ■ V - - 



relationships. This is unfortunate aajd again emphasizes the developmental 
aspect of the state of the, art of mixed income testing. 

Chapter V provides some recommendations that, if implemented, could^ 
enhance the conduct of mixed- income testing. 
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CHAPTER V 
RECOMMENDATIONS 



The mix^^4-4«come e^xperiments as devised by the Youth Employmen: and < ' 
^ bemonstration'VriJjects Act were specifically intended to find answers to 
difficult questions about the effective grouping of youngsters in employment 
and training programs. .These experiments were planned to test whether and/or 
to what extent income-eligible youth benefit from working With and being 
trai^ned alorfgside nonincome-eligible youth. Unfortunately, as the findings 
in Chapter III reveal, no definitive conclj^sions can be drawn at this'time 
regarding the mixed income hypothesis. MBA has suggested in Chapter IV of 
this report some reasons for this lack of conclusiveness in these tests. 

In this final chapter o^the report on the status and results of t>e 
1978^nd 1979 mixed income tests, MBA is proposing a number of recommendations 
that, if implemented, could enhance the quality and level of experimental 
rigor and control in future mixeM income testing. The mixed income hypothesis' 
merits further investigation, and MBA agrees that the pretest/post-test control 
group -research design is the preferred technique\for such an investigation. 
Within this context, t4BA recomm^s further consideration of the following 
elements for inclusion in subsequent mixed incpme experimentation. 



\ 



• Variables 

• Controls for Attrition 

• Controls for Confidentiality 

• Standardized Pre- and Post Instruments 

• Standardized Follow-up 

• Standardized Length of Program Ihvolvement 



Each of these elements is discussed as follows. 



Variables 



Sex of Parti ctparH^ ^^/^ 

A^^variable that emerges in much of the manpower literature 'is the sex of 
the participant; however, the significance, of the sex^variable in job training 

J ' ' ' ^ 
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and job performance is not clear. Results have been controversial. 

Nevertheless, sex as a variable should, be included in the mixed income tests 

simply by requiring that the participants be equally divided between males and 

females *in a^l sites undertaking mixed income experiments. * 

.« 

Age 

E)(perimental and control subjects in mixed- income tests should be 
matched for age. * ^ ^ 

Level of Interaction Between^^Participants 

All programs need to provide a measure of the interaction between ^ 
participants. The basic contention regarding mixing youth by income^Jmplies 
that interaction between these youths from different income groups is^ crucial. 
The level of interaction should be specified in any site conducting a mixed 
incgme'test. ^ • • 

Type of Program 

Two types of programs should be included in future experiments! Programs 
for both in-school and out-of-school youth should be devised and specified 
consistent with services generally found at the demonstration sites. 

Ratio ofylncome-Eligible to Nonincome-Eliqible Participants , ' 
The basicUoatention of these studies is that mixing participants by , 

.income will effect program performance. A secondary variable is the type of 

f 

ratio most useful. The ratio of income-eligible to nonincomeo-eligible 
participants should be specified and maintained throughout any test. 

' e 

Extent of Income Differential ' / ' 

Two ranges of income difference are proposed for future mixed income ' 
These ranges are based on the Lower Living Standard Income Level 
At the present time, ii^me eligibility for youth pj^gram participation 
is cut off at#85 percent of the LL'SIL. For future test^ it is recommended that 
at lea^t two ranges of income difference be examrned. The first range is 
..125 perdent--175 percent of the LLSIL; the second range is 175 percent and * 
above of the LLSIL. In all case's, aji' exact, income figure .should be required for 
all experimental and control subjects. ' ' • ^ 

. V-2 
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Controls for Attrition ; , . 

It is 'Well known that the attrition rate in YETP projects acrossy^^he 
country caa^be as low as ten perpenf and as high as fifty percent./ Any site 
undertaking a mixed income tesi should consider the typical attrition rate for^ 
its respective program and enroll subjects for the mixed income test accordingly. 

Controls for ConfidentiaJity 

Confidentiality ijXery important in these tests becaki^e of tRKneed 
for income data and the' need to decrease the possibility ofle^ESIl^^ 
contamination resulting from too mafiy people knowing aboor test. 
Confidentiality with'the income data^can be provided thnbughY^atever usual 
channels are used in Bach prime sponsor. The nature ofr the tegt and. the -identity 
of the experimental and control subjects need to be protected as diligently • 
as possible. The manner in which confidentiality will be treated should be 
stated in mixed income test proposals. , 

standardized Pre- and Post-Instruments ' ' * - 

It i^ recommended that alVs>^es engaging tn mixed income tests be 
i.nstructed to use the same pre- and post in;strument to measure basic attributes 
of interest. The test package devised by the Educational Testing Service 
should be corteidered, though it is long and may be a burden to smaller^primi 
sponsors. A-. shorter package can be selected that will allow for the possibility 
of meaningful comparison across all sites conducting mixed income tests. Sites 
would be encouraged to use >/^atever other instruments they deenij^appropriate 
to the particular needs of ^their s'fervice mix. ' , . ' 

\ 

S'taq/^ardized Follow-up ' . - . ' 

All sites should'be required to conduct a follow-up o^ mixed income test, 
ex^rimental an(i control subjects at three- and eight-month intervals. Th"^ 
purposes of the follow-up are many; specifically, one is to de^mrine how 
long any effects produced bf the income mixing 'persist. 



Stancjardi zed length of Program Involvement 

y Any prime sponsor electing to. conduct^ a mixed income test should 
prepjared to maintain the services for experimental and control subjects 
at least six months. Not much effect from mixing can be expected from 



be 
for 



programs running the test for a shorter period. 



I 
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APPENDIX A 
CASE STUDIES 
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•APPEMJUA 
^CASE STUDIES " 



^ Each of the 47 tests proposed for FY ]fI8 or 

FY 1979 ar^d^^ibed' in the following case st<^dies. The 
c^se studies are grouped by region., ai^d m order in merit 
or value, is implied by their position in this appendix. 

The reader ig^referred to Table III-2' in Chapter 
III for a listing of the sources of data for each case, 

Suffolk County^, New York; Northumberland County, 
Pennsylvania; Indiana BOS; Lansing, Michigan; and Trico- 
C^TA Consortium in Racine, .Wisconsin, are ^ach reported' 
in one case study. The reader will rtote from fable III-2 
that each of 'these prime sponsors conducted two mixed \ 
income tests, either one in each fiscaT year o.r 'two 
Concurrently.^ The one^case stuldyHjescribes both tests. 



it 

1 



89 



NEW YORK CITY, NEW YORK 



New YorWCity proposed a^fnixed income experiment for FY 1978, but a 
deteQ ^nati pA^f prAgram conduct and results is not possible at this time 
because of unsuccessful a^J^mpts to irtterview program operators. The 
fol Imping is an account of their propo*Sed effort. . * 

*^ The program y/as Jto involve two program activities— career employment 
experience and classroom training. They prepensed to have an experimental 
group that would provide interact^ion be^en participants from the two 
income groups, and a control group consisting of only income-eligible subjects < 

f • • 

J Services to participants were to include career counseling, occupation 

f 

information and referral, and variou§ placement services. 



/ 
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• ' NIAGARA COUNTY, NEW YORK 

Introduction ^ ^ 

A number of specialized services were provi for physically handi- 
capped yputh in a mixed income environment. The findings were fairly 
inconclusive because data collection strategies were not specified, 

r 

Test Approach j ^ 

The mi^^ed^ncome test at Niagara County, New York .was conducted by 
the Niagara C^ufrt^ Community College, a subcontractor to the local CETA pn'me 
sponsor. This test, conduc^fed between July 24 and September 15, 1978,'^as 
designed to provide training and work experiences for handicapped youth. 

The experimental agd the control groups served the same number of \ 
participants for a total of 32 subjects. The control group contained only 
Income-el igi-ble handicapped youth who were 16-21 years old. The experimental 
group contained 8 income-eligible and 8 nonincome-eligible handicapped youth 
in the same age group, Y ^ " 

The services rendered by Niagara County were extensive and included 
special transportation- and, other facilities for the handicapped. Counseling 
was. conducted on .an individual and group basis, ExiserimentaT subjects and . 
control subjects did notjnteract with each other, 

' ' . • ■ • • ■ • ' ' \ . 

Data Collection Strategies , ( ^ 

The nji»ber 6f unsubsidized^lacemeryts obtained by those in the 
experimental , group was compared to the number-^of placements .obtained by the 
"dontrol group and ot^er factors, such /s the program completion rate> the 



placement rate, the number of dropouts, and the amount of other special 
attention required were measured. It was believed that pre- and post-tests 
were administer^y, but the extent of these tests was not reported. Some 
follov/up was conducted at regular interval §. . 

- • ■ . . ^ 

The data from this test of the mixed income hypothesis are inconclusive. 
However, it was reported to MBA that "the greatest outcome of thi^s expftrimenf 
was that it increased self-confidence tn the^ participants and provided an 

opportunity to help handicapped ymth a(Jpust to a typical work settuig^ 

, -^«'>*' 

Analysis . — ^ 

This test 'applied the standard mixed income hypothe§i? to a special 
population--the physically handicapped. Positive cha'nge for i>come-eligible 
subjects was measured in several ways relevant to job placement, program 
' retention and the like. -Other kinds o^ positive change, such as self-concept, 
motivation and so forth, were nQ;tjp^ti(|nalized. Pre- and post-test 
procedures were not described. Impact of mixedj'ncome grouping on the income 
eligible was not adequately measured by this mbced income test, and a . 
quantitative assessment of mixed-income grouping for handicapped youth cannc/t 
be detennined. 



/ 
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STEUBEN COUNTY, NEW YORK 

c 

Introduction / 
/ 

^ Alternative educational experiences and exposure to the world of work 
were the services that mixed income test subjects and controls received-iQ^ 
Steuben fCounty, ,|ew York. A follow-u^^ompleted one year later, suggests a 
lower than aVerage dropout rate implying that mixed income grouping had some 
benefit for participants. 



Test Approach ' ^ ' . * 

Steuben County is a rural community located in the lower end of central 
Nef^York State, halfway between the state's east .and west borders. Farming 
and medium size industry are the major aventjes of employm^ here. The 
County Manpower Administration subcontracted its mixed income test to the 
Wildwood Career Center, j)art of a two-county (Steuben and Allegany) Board. of 
Cooperative Educational .Services (BOCES). ^ 



From February to June 1578,^ students participated-^in a program^ ^ 
emphasizing the' development of vocational skills'and tyasic aca\i^ic skills 
at the Wildwood Career Center. Of these 24 subjects, 12 w||^' expiri mental 
subjects (6 income eligible andv6 nonincome 'el igible)i.and 12 were control 
subjects. ^ , ^ ^ ^ •* 

Data Collection Strategie s ' / * ^ . 

■ ^ ■ ^- ■■' 

A Behavioral and Progress Report used to assess the students' 
behavior retrospectively and to devise a baseline^flS^m ch i^to gauge future 
assessrrients . Post-tests used a similar instrument, and a follow-up Was com- 
pleted in early Hay 1979 to determine the current status, of the 24 participant 



One year later, ten of ^the original twenty-four subjects were still 
active'in^a BOCES program /eight.wefe* working full time, and si)thad left 
school- Whether these were the iAcome-eligible subjects in the mixed or, 
norlmixed group setting was^^ ^ot made clear. / 



T 



Respondents^ froBi*tbe prime'^onsor's office and the subcontractor s 
office felt that the findings' were^Vdt conclusive in supporting the hypothesis 
that income mixing had a salutory effect on income-eligible partl>8i pants. 
•Their. reasons were: ' r 

• • It was not' possTble~to pair participants as 

completely as desired 

*> . . ' 

• There was a limit'to *e variety of work sites 
available-for plicemertx^ and full matching was 
not alv^ays possible at, Work sites 

* • February to June was not sufficient time to 

conduct the test ' " 

— t The lang'uage of the ortgin^f DOL proposal was 

not as clear a^ would have \>eer\ helpful <> 



^ WitTiin these J imitations,' respondents felVthat generally positive 
effects were achieved. The very existence of a special iST-pject gave a "boost" 
to staff; it enabled the /program to include a new unit in their, teacbing in 
thfe fortn of a tour of local indu^tnes, and it gave students an opportun;! ty' 
to learn abo(/\he world of work through experience. . . 

' Analysis 

Variables were pot clearly stated in this test of the mixed income 

4 . • I 

hypothesis, and the retrospective approach to col lecting .pretest da>ta violates 
test requirements. Results W not reported separately for^'subjeCts in mixed 



r 



y 

groups and ndnmixed groups, so the effect of mixed income grouping canno't be 
specified. The use of follow-up one year after program completion is 
f commendable, but these data nefed to be reported in a more usable fastiion, 

\ 




SUFFOLK COUNTY, NEW YORK ^ . 



Introduction - - • " 



' Several variations were'-us^d to explore best \x\ ten^s of the- . 
grouping of participants the experiences .proi^id^'d-apd/or Jthe wages xiiUted.^^ 
Out-of-scho'ol youth rece'ived" job .experienqes in these tests of the m,ix$d 
income hypothesis. Mixed^ncome groups did, not farp better that^' nbnmixed on 




Test Approach '^ - , ' • . f ' ■ - i'-. ' * • 

T\fO"tests. of the mixed income Iv^pottiesls are destribed" in this. cSse - - 
study of Suffolk eounty', New; York. ^ Suffolk "^County .iS on the tip-.of i-on^ . 
Island," and it is a. mixture of residdfitial' and^reoreationaY.aBeas, wilib a .■ . 
, seaside view. Farming and Jight 4ndust> pro^vide. empW;nent, and mani.Vorb ^ 
1ft neaf^ysRassi^ County pr^JJew' Y6rk,Cit.y'.' * ■ ' ■. ^ • . , Vv " , 

V l:''t»4m'llbf^^^ SepteJbeV^978, the^tBTA-iniW sppnser in Suffolk,'.-;,^ 
' Co^tty'tonducted a' tes.t of the mixed income hypothesis! Jhis first stady^ % 
' examined three vaViatio^ns of the mixed income hypothesis. The^e wei^e: 



> 1 



(1) . Income -mixing witl result in greater program benefits " 

to income(-eligible -youngsters. 

\-. 

(2) Income mixing and higher wages will increase the- 
aroductivity, motivation, detention rate and transition 
ihto uns^bsidized employment for the income eligible. 

(3) Income mixing and intensive individualized counseling 
will result in greater program. benefits t9- income; 
eligible youngsters. 



y 



J 
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Fourteen experimental subjects were cofnpai^ed to 14 coYitroV strbjects in 
the FY 1978 test/ The ratio of income .eligible to noninconie eligible is n^ 
clear, * ^ ' - * , ^ 



FY 1979 Test 



A similar test is befng conducted in*Suffolk County during FY 1979. 



However^ ^"ore subjects are included .tft.prj)mQlfi^reat£n^<taTa analysis. The 



control group isxompose'd of 120 subjects, and the experimental group has 120 
subjects (40 in each of the above variations). The ratio of income eligible 
to noninconie eligible is not known. ' ; ^ ' • 

Data Collection Strategies * ' ' . 

.Pretests were not usedo'n eitl^fir of theSe approaches to the mixed 
o'Ticome hypothesis.' Post-tests did examine v^ork quality and quantity, 
■dependability, attendance, ''initiative, courtesy an^ attitude in the FY 1^'7'8 
/ftest. 

The second' variation of the hypothesis used- in FY' 1^978 was not 
confirmed. As a matter of fact, the* group paid'lesS money had a significantly 
^ lower absentee rate than the group receiving higher wages. All other data are 
nonconclusive primarily because the sample siz^ in the FY 1978 test was, small. 

' No results Were available on the -FY 1979 test at the time of this report. ^ 

Analysis ^ r \ ^ ' . ^ - 

The two variations of the hypothesi_s proposed by Suffolk County are 

\ . . » . _ 

interesting,^ but they may distract from the major need to examine the effects 

of income mixing. Indeed, the results regarding income mVxing are inconclusive 

and probably confounded by the other variables under investigation. 

ERIC X. . \ ^ 
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NORTHUI^ERT^ND COUiJTY , PENlfSYLVAN lA • C 



Introduction 



Classroom training and work experience were -combined with career 
counseling in this mixe^Jnc(pe-t-esrfr--fai''#e4^^ 

occupational categories in mixed pairs of incQme-eHg^ble and^noni ncome- - 
e.l.ig'ible youth. Results for the first year of this -test shcJwed income-" 
eligible- youngsters performing. better than the nonincome-eligibje youngsters. 

Test Approach J , , * . 

This case study on NirtlTvmberland County describes mixed income ^ 
■tests- conducted in FY 1978 and FY .1971' Thfe effective dates for the^FYS^ 
'test were January 16 through September 30, 1978, and Jhe fY 1979 program ■ 
started October 1 , 1978 and wi-11 run through September 30,^-1979. The 
prbg^* design in both tests provided classroom training and a variety of . 
work experiences to'mixed income gVoups of subjects. 

•■ " ' ■ ' 

Thirty- six students participated in the FY 1978 prograra.\ Twenty- four 

of the^ were in the "experimental group (12 income-eligible yd\ith and 12 

nonincome-eligible youth). A control' group was established that consisted 

of 12. .income-eligible youth. Participants from both. groups wefe recruited 

from three local educational agencies that conducted the initial screening ^ 

of applications. All income verification was conducted through the use. of 
• . — •• « 

parental^guaTdi arrfonns\ , ' ' - 7^ 

Participants -chos^r^ for both groups were matched as closely -^s 
possible for their work- site assignments, based on sex, race, education . 
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attained and grade ipoint average. * It was* noted that, while an attempt wal, 
made to have incoqie-eligible. and nonincpme-eligible participants work 
alongside each 6ther,,!this was not' always, possible. 

. D a ta Co-Ue^i^ofi-^-SCr ^t e gi es ■ — ~ ~ — — > 



Periodic progress reports measuring the amount of change in £ach 
^ participant were prepared by the work site supervisors. Participants 
completed' self-evaluation forms and questionnaires at various intervals 
throughout the courseiof program operations. ' These data we're evaluated by 
the staff to gauge the ov^ra A effectiveness of-the program. Ultimately, 
. these evaluations will be usedto facilitate rational decisions in an effort 
to improve student ^learning in the YETP program. V 

Analysi s - . ^ " ' 

• . • " * ' ■ . ;^ ' 

^ ' The results of the FY 1978 dan,onstration stiowed. that income-eligible^ 
youth-worked "as good -as" to "b'eti^r .than" noaincome-eligibW youth. This 
conclusion, was. unexpected by the^taff and was a factor in their de(cision 
to continue the research. mi FY >Tg^9. The FY 1979 program will hppefully 
shed some light on why the ripnincome eligible are not performing as 
e)tpected. There are no results to report on the effects of income mixing. 

_ .The Northumberland County Martpower Administration viewed the" mixed 
income tests as "goodj' (as opposed to "very good" or "excellent"). In 
fheir assessment the validity of test results was questionab'le due to 
inadequate controls and dubious^ research criteria. It was learned from 
'the interview that n6 pre- or post-tesl^as '.administered, and the amount. 
of interact-ion with^in the experimental group may^not have been Sufficient ^ 
to i)roduce /^he expected impact. • , . ^ 
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MBA is reluctant to call the tests "good" because neither of the 
_tests is really looking at the mixed income hypothesis. These tests are- 
-comparing the perfomance of the income eligible ta^e nonincoroe eligible 
in'a typical. YETP project, and this is totally /bntrary to the mixed income 



hypothesis. 



s 



> 



ERIC 



V 



A-ii 



f 



'♦Introduction 



SqHUmLL-€ARBON COUNTY, PENNSYLVANIA 



:;This proposed ten percent component was to be incorporated into the 



prime sponsor's^ in-school work experience program. In 50 percent of the 

*^ ' » , 

in-schpol work sites, participants from income-eligible and nonincome-eligfble 
batkgrounds were to mixed, while the remainijrig 50 percent of work sites , 
wo'uld^servje only iticome-eligible youth,' who would serve, as the control groups. 

Test Approach . . ' ' ^ . ' ' 

The^l lowing issues were to ^e examined in this mixed income approach: 

• ' The value of integrating participants with varied family 

income levels and background^ > 

• The relative cost-effectiveness of different program 

• approaches for target grouped participants , • * • 

• The effects of pi;ogram opportunities on the prospects of 

*v linsubsidized youth* empl-oymetit and school completion 

\ • ^ ^ \j 

• Thte value of woVk generated by jnixed income grouped employees 



The to t^r number of slots in-* the mixed i 



n^ome component was to be 410, 



Of this number, 102 slcJt^were allocated to nonincome-eligible youth, who 
would be mix^-with 10^3^come-eligible youth,- and 205 slots wer^e allocated 
tq^the control group, all of whoni) were income eligible. 

Data Collection Strategies 

Fo^ow^up proj!:edures would be geared toward tracking and evaluating 

r the i/- 



the above-stated criteria. In addition, follow-up procedures f6 
component would incorporate school completion/retention data so that th^ 
objectives of an outcome study could be obtained. 
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Analysis ' . ' ^ " . , • • 

This ten percent demonstration program was never^initiated in Schuyky]!- 
Carbon County -because of problems in getting grant applications approved. / 
However, -this is probably just as well in. the, MBA opintor -because too many . 
TiFraMerand:;conceF^ not opemix?ncrl 1 z ed . diid the f icoposei^approactebth- 



/ ^ 

data collection was not targeted. 
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VIRGINIA BALANCE OF STATE 
BATH COUNTY 



Introduction 



^ This work-study program is de signed to provide potential sc t^ol dropouts 
with a viable alternative-^o traditional classroom instruc^iop. Participants 
receive cl-assroom training in Adult Life Skills on the pfemise l^at, these 
skills can,be translated. Into other kinds of changes. As^a result o'Pexposur^ 
to this program, participants are expecte'd to develop more independence and" 

responsibility and have greater interest in becoming .gainfully employed. 

* ■ /' <• 

' Bath County, a rural community in Warm Springs, Virginia, is a popular*- 
r'esort area in the summer m6nths. Resort areas, ttre school system and a^^ | 
garmeat factory employ most of the r^ident.s. 



Test Approach " " ^ 

The Bath County School Board, a subcontractor to the VirgiMa Balance *. 
^of State for the mixed income test, started its^^program in February 19^8 and 
is'continuing it through September, 30, 1979. / ' , . * 

Thi^ mixed income test was integrated into the Bath Youth Conmunity 
Improvemer(t Pro!j^ct (BYCIP), an alternative education project, fo*r poterttial , * 
dropouts.. The'ultim^e goal of BYCIP- is for eacfT participant "to gain - ' 
attention, success and^ recognition in constructive rather than .destructive waysT" 



• The program started with 5 noninCome-e'Hgible, -participants and 15 income- 
eligible participants. A^ the time of MBA data collection, there were "2 
nonincome-eligib.le and 17 income-eligible participants. The^ofea.1 number of 



r 



* participants has vaci Lifted' between 17 and 21. This variance can be attributed 
to* subject loss- either through dropout or positive termination. 

' _ ' The majority of participants in the program are white males ranging 
from 15 to 19 ye^irs'old. All have demonstrated an inability to^function ^ 



adequately in a regular'hi^h schjool setting. One Ve^pdndenV also noted that 
many participants come from homes experiencing special* difficulties. 



Data Collection Strategies 



Specific indicators of change observed are academic behavior and 
' performance, personaf behavior and cooperation, . and some measure of cumulative 
''change. Academic change is measured numerically; personal behavior is measured 

by teacher/supervisor evaluations. These two categories are totaled to give 

a net growth pattern for eahh individual participant. 



Although no pretest was adm-^nistered and no post-test is anticipated, 
case studies/on each individual are prepared by school staff at the time of 
entry to the program, and intermittent evaluations serve to update this i 
information. A. comprehensive post evaluation is complet^dTYor each student 
at termination. • , / ^ ' 



Analysis 

' , -s The program is ongoing, and results^ have not been completely analyzed, 
However,' these preliminary findings were noted: 



• ■ The alternative program has provided students with a 

needed sense of "identificatjon" or "group cohesi veness" 
■ that may have hielpeci keep them in school 

• As students become actively involved in p^-oject tasks, 

>«, there is an obser-vable rise in their sense of self-esteem. 
|i Many students have a low self-coneept when they first 
• enter' the program 

I • • - '. 

• . \ 
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, Thi5 test-fails to meet- -research' requiremer>ts established by the 

• -^-^ ^' ' * 

Department of Labor for conducting mixed income experiments. Tiiese , requirements 

include pretesting and using control groups, each of which is.criticaT when it"^ 

comes\to assessing the effectiveness of mixfed income g^rouping. Although this 

test may have helped Bath County confront some of the needs of its nonincome- 

eligible ^puth, ^t does not yield nruch information on mixed income "grouping. ^ ^ 



r 
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VIRGINIA BALANCE OF STAT4 
GibES COUNTY 



^Introduction • . , '. v 

An alternative to typical school 'Tiistructi on provided to 30 

•/ • . * ' ' ' 

participants in the "PATS'" (Pos.itTx^e Approach, to School) program. Eight of ^ 

the^sfr'a re income eligible, 8 are'^ortio^ome ehgible and 14 are control 
subjects. I'rogress is based on ^physical/ appearance ^^^^s^scores and job- 
related behaviors. 'Income-eligible youth in the:iiJixed setting appear to be 
progressing better than youth in tjiejionmi xed setting. Data are very 
.inconclusive at this'time, however, because the test is still* operating. 

Test Approach 

Giles County, a rural comjunity in Pearisburg, ^frginia, is 70 miles 
' from Roanoke. Unemploymen^n general, .and yputh unemployment in particular, 
is high and problems of drug and alcohol abuse exist. These problems are not 
limited to low-income'youtfh and are reasons for conducting the nvixed income 

test The Gil as County bchool Board was the .subcontractor to the Virginia ^ 

■ " ' (' • - • ' 

, Balance of State for this' mixed -inopme test. 

;" \oungsters who cannot /unction in the re.gular».higb school setting are 
placed in the PATS program^ based on t-heir special needs arid their potential 
for improvement. It is within the framework pf the PATS .program that the ■ 
present mixed income experiment is being conducted. This mixed income test 
started in Cfetober 1978 and' will run through September 1979. 

' . ' . .... 
The typical PATS -program provides academic training, vocational training 

and counseling to participants. Of the SO^JATS slots av^lalxle, 16 were 



ajlocated to the mixed income experimentaV group. Eight of, these were income 
eligible, and & were noninconle eligible; The remaining 14 served as control 
subjects. Participants are periodically measured on a number of Attributes 



to deterrnine progress. - ^' ■ 



Data Collection Strategies \ ' 

.Participant progv^ess is based on demonstrated improvemenf in physical 
appearance, attendance, aca.demic performance, vocational performance, use of 
wages and commitment. Pre- and post- tests were used that measured these 
attributes. Because the program was still operating at the time of MBA's ^ 
data collection, no definitive findings were available. It appears, .however, 
that income eligibles are progressing as well as the nonincome eligibles. It ^ 
further appeajrs that those income-eligible subjects* in the mixed group are 
progressing bext'er than those in the nonmixed group. 




>Analysis ^ - • ' * , • 

The test managers in Giles County fiave conformed to the requirements 
established for conducting a mixed inOome test. The data necessary to analyze 
the effects of mixed income grouping will be available. The orientation of the 
test inanagers does not seem consistent with the^dictates tJf the mixed income " 
t^st and causes some concern. Too much emphasis was ^placed On comparing the 
income eligible to the nonincome eligible. This should be corrected and data 
should be analyzed based on the effects of mixed income grouping as opposed to 
nonmi>;ed income drouping for income-eligi^e subjects. , , ; . ' ^ 



\ ■ . 



^ * ' - VIRGINIA BALANCE OF STATE- 

• . PRINCE GEORGE'S COUNTY 



^ ' .Introduction 



1 



\ 

\ 



\ 

A summer work experience was provided to income-eligible and nonincome- 

V - ^ : 

eligible youngsters. However, no data were collected on a pre or post basis 
.on which to develop any conclusions. ' . \ - \ 

Test Approach ' ' n ^ - > 

"^Thrpe "^ervices were rendered to the participants during this test of 
the mixed i^icome hypothesis. These Were an orientation session on job skills 
prior, to job' placement, individual -and group counseling, and training and 
ertiploymenjt. * V. 

. \- .. ./.- • - ■. ■ 

' The Prince George ^'s mixed income test began Jun^ 12, 1978 and; lasted 
until September 9, 19*78. Neither pre- nor post-tes^s w^^ administered during 
the experiment to measure variables or change, j^ijrthennore, studerrts^ 
f . employers and staff were aware that the experiment was, in operation. Nonincome 



eligible SAibjecfs knew th'at ten percent of^the^YETP funds had been set. aside, to 

give them empTi^yment that they ordinaril^ would not have been entitl^ed to 

receive. ' ' ' . 

I ■■' : ■" 

Data Collectioil Strategies . . . ' ; 

There were no pre- and post-tests used in this iht)(ed income design. 

Observations were used, and it was noted that interaction In the experimental 

group was high bjfetween the income-eligible and nonincome-etlgible subjects. 



Analysts • * , ' * . 

' ' / • ^ 

There can be no meaningful quantitative-.anertysi'S of this test of thfe 

( . . • i . 

mixed infome h^othesis because no" data were collected. / This test also " .. 
violated requirements by not using a control group of subjects. , This test 
did help s.tudents adapt to the world of work and gain .insights into potentitil 
employment opportunities. Ittlid'not, however, meet .the major established ' 
requirements fo^^ a mixed income test^ - • ' • 
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STAFFORD tOUNTY ' ^ ' ^ 
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Introduction . ^ , ' , . , ' ... 

• An in-school work-study program was s'ubcontraclned to thfe 'local school 

< • • • - 

board: Testing or prescreening was not cjone. ^ However, there is a 1:1 ratio 

of student to \5uper*v.isbr, and anecdotal reports are made at frequent intervals. 

Results 4re inconclusive' because the test is still in operation* 

" % ^ • 

^ Test Approach ^ ^ . 

This FY 197.9 test of the mi*xe5l .incoftife hy^othesi-s -provides classroom 

. ' / . ' ■ • • • :^ 

instruction* on-the-jpb training and placement to 30 participants. Twenty-seven 

of these are income-eliajble youth ^ind three are' hoijinconjg-eligible youth/ 

students were selected by random sampling, and 3*31 income verification was 

done by the Virginia Employment Commission. 

Data Collection Strategies . * \ , ^ ^ 

Two variables are being used to cleterinine' participant change. Th^se 
,are work at±4^tudyand attendance. It is not clear how these variables ere^ 
-systematically measured, ^byt subjective evaluations on eaph participant 
are con(3ucted about once a month. , ' . ' ' •. 

Anafys^i s * . - * 

None of the research requirements was followed in this test of the'"^ 
mixed income hypothesis. Neither pre- nor post-tests were used, no control ^ 
g»?oup was used, and the small percentage of nonincome-elijgible subjects 
suggests very little chance of meaningful interaction beVween income-eligible 
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and nonlncome-i^ligible subjects- This test is stiTIJn ofieYation but will 
probacy not yield any meaningful results with respect to the mixed income 



hypothesis when completed. 



A-22 



VIRGINIA BALANCE OF STATE 
STEPHENS CITY 



Introduction 



Income eligibles and nonincome eligibles are mixed in a nantrjrai tjonal 
vocational school setting in this test^f the mixed income hypothesis. Pre- 
and post-tests were not used; hcJwever, the observation of personnel associated 
with the test is that the mixing is not causing any difference in the behavior 
of income-eligible subjects. 



Test Approach - ' 

The Dowel! J. Howard Joint Committee for Control the sufe^contractor 



to the Virginia Balance of State for this test of the mixed income hypothesi-s* 
Dowel! J. Howard is a vocartiona! school providing alternative education' 
exf3^iences .for youth who have demonstrated an inability .to function in 
" traditional school settings. Thisjtest, which staVted in OctoBer 1978 and^ 
. will ^continue through September 1979, is designed to meet the needs of non- 
injpome-eligible youth who would beneifit from the^^^^^gram services they would 

otherwise be ineligible to obtain. The mixed income subjects, received the 

\ 1 ^ " 

same services ordinarily rendered by thfe schooj. 
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The participants in the demons tration^prpgram were all in-school youth 
at -the junior high school level. All students had demonstrated an inability '* 
to fiinctjon in the .traditional school setting, and a majority have been 
labeled "problem children." Total enrollment in the ten percent component 
as of April was 32, 29 of whom were income eligib^]e and 3 of whom were ^ 
nonincome eligible* This proportion varies as students are terminated from 



the program and others are 'added. 
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The prbgram offered 'for the ten percent component provides both 

classroom learning and work experience. The general distribution of t 

<, ^' ' ' * * ' ♦ , 

participant activity is half academic learning and half work* experience. 

Cfassroom courses ihclude reading, math ^nd 'general academic subjects. The 

* ^ ^"""^ * ^ . . 

wqrk experience component operates dn a rotating basis with participants 

spending nine weeks at a job site. In this manner each student is exposed - 

to a wide variety of career opportunities. 

^ y ^ 

D ata Collection Strategies ' r - 

— r 

No pret^stjS-j/ere adnwnistered to the test participants and no post- 

tests are anticipated. However, all students were required to take the 

♦ 

"ABLE" test, which gave individual academic ratings. Observational data , 
Kave been ji^rgF^ assess attitude, punctuality, attendance and general sense 
of^ responsibiT^ity. No conclusive resulj^^an be reported at this time. 

4 ^ 

Analysis - ^ • 

The ten percent component operating in Stephens City is lacking in 
many of th? elements essential to a research design. The absence of pre- 
and post-test instruments' and a control group make any results highly 
questionable.* Jt seems that the real objective of this program was to serve 
-a larger, population rather than to test the mixed income hypothesis, so any 
findings are suspect. One tintative finding is that mixed income grouping 
is causing no difference in performance.. This may be because so few^ 
nonincome-el j:gi-ble subjects were, used in t\\\i test.^ ^ . * ' 



\ 

VIRGINIA BALANCE OF STATE. 
• : - " VIRGINIA EMPLOYMENT COMI^SSION 

Introduction . * . , * 

This test of the mixed .income hypothe'sVs was essentially a program 
V to expose youth of all inpome levels' to tfie world of work. Convocations 
and workshops were held at area high schoofT, but no data were collected. 

, .. • "/ , ^ 

Test Approach ... % 

' From January to June IQySj'^graduating seniors from Wise and Lee 
CouH'ties were exposed to basic knowledge and information necessary to prepare 
f^rJlocate-and obtain jobs in a one-da/ tj^ansition xourse. . This program 
• was conducted in conjunction with Mountain Empire Communis College and 
^ used "mobile learning labs*' for the implementation of the course, ^k 



was 



estimated that a total of 345 seniors participated in this one-day effort 
at meaningful career exposure. 

The .one-day program, consisted of presentatio(is and discussions .on 
carreer* opportunities and development, and information packets were 
distributed 'to all participants to review./ Each subject completed an 
attitudinal survey form, which served as the evaluation tool utilized in 
completing the analysis for this experiment. However, no systematic data 
were collected on income, so the percentage of nonincome el ig'ible served 




7 

is not known. ^ 

Data Collection Strategies 

There were no systeipatiq data collection strategies, a(nd even the 
/ attitudinal survey administered was not analyzed. Pre *^anci post measures 
were not features of .this test. 

^ ' ■ . V - 114 
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Analysis » " , * 

This was riit a test of the mixed Income hypothesis. It did provide 
a one-day "approach to a multitude of job possibilities and training 
opportuni-ties, but it did not examine the mixed Income hypothesis. 




WEST VIRGINIA BALANCE OF STATE 
WHEELING, WEST VIRGINIA ' 



^ Introduction 



This program provided ^ut-o'f- school youth with skilled training in 
major appliance repair on the campus of the local community^ollege. Pre- 
and post- testing and three follow-ups were l:ey approaches to data, collection. 
Income-eligible youth performed better than nonincome-eligible youth in 
either the mixed or nonmixed group. The follow-up is continuing on these 
subjects. * 4 



Test Approach 

This test of th^ mixed income hypothesis was subcontracted to the 
• West Virginia Northern Community College and was conducted from March 1 to 
September 30, 1978. The program was designed to p^rovide participants with 
classroom training in major appliance l^fepair. This concentrated effort was 
to provf(Je in-depth knowledge and extensive woriit experience to participants 
resulting in fully qualified repair technician^ upon completion of the 
program. All activities took place on the campus of West Virginia Northern 
Community. College utiliz^g the faculty staff. 

Thifty-two^students participated in this FY 1978 demonstration 
program. Sixteen were, in the control group (all income^eligible youth), ^ 
and the remainder formed\he experimental group ( eight ^nonincome aligibliBj 
and eight income eligible). The local job serv.ice was responsible for all 

intake ^procedures, including income verificatibn. Each stCident was then 

» * * • * * 

interviewed by college staff and final selections were made. The job 
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service staff, college administration and faculty were knowledgeable of 

^ - ■ . w - 

the nature' of the research being conducted, but the participants were • * 

unaware of any testing. * 

Data Conection Strategies < ' 

Two basic techniques used^o measure change were"" pre^ and post-testing 

amT^llow-up to determine the naturae of program termination. 'The- pre- ' 

^ ^ and post-test used^was the' Tennessee^ Self-Concept Scale, which measures i 

motivational levels, attitudes and self-concepts. The student's scores pn 

the pre- and>est-tests we<^ compared to determine whether the stS^ent's 

\ ^ attitudes about work and his motivation had been positively influenced: 

These tests also indicated any differences existing between the experimental 

subjects a^d control subjects. ^ 

' ■"' ■ f^, ' _ . 

The number of students successfully completing the program was 

' -/i • ' . '. ' ^ * 

^ measured against the original total enrollment. The number of students 

employed will be measured at three intervals after progr^im' completion: 
* 

' immediately, six months later and one year later. 



In additic^ tp these two' stratefTes7"sub,jeGts were given' the 
opportunity to evaluate the program activitie*^Svery four weeks throughout 
their participation. Even when a sul?j[ect left the program, a participant 
evaluatioD was requested. ' ' ... - ' 

« 

Analysis - . ^ « ' , / . 

overall results to date indiciite that tfie income-eligible youth in 
. the control and experimental gr*oup functioned "as well as or better than" 

ERIC . '/ ^ . ' 



the nonincomef-eligible youth • However, no data are available regarding 

f ^ > " . .. 

the effects. o¥v mixed groujfing which suggests strongly that 'tha basic 

thrust of the mixed income test was missed in this study. ' 
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<^ ' BROWARD COUNTY; FLORIDA 

■ . : ■ ■ ' 

Introduction . ^ • "'^ 

In this test of the mixed income hypothesis, youUW apprenticeship . 
training in retail sales or priMing was paired with guided group inter- ^ 
action. Multivariate analyses were calculated and yijelded no statistically S 
significant differences based on participant groupings.. 

Test Approach ) ^ 'f' 

From MarChJ to September 30, 1978, 70 subjects participated- in XM 

mixed income stoSy in Broward County, Florida. ' Eighteen of these were 

nonincome eligjble. No^cpntrol subj^ects were used. 

Participants' were divided into two groups. One group attenla^d_ji 

retail sales class and nine hours per week of guided^oup int^action; 

the other group attended a printing and graphic arts class and nine hours 

per week of guided group interaction. Each group was iiixed by income and ^ 

observed over the course of the project. 

Data Collection Strategies 

Pre- and post-test instruments, were used that were designed to tap. 
a number of attitudes such as motivation 'to work,- career aspiration find 
self-concept. Follow up of placement and later sucQess was also a data 
collection strategy used in the Broward County test of the mixed income 
hypothesis. No statistically significant' differences were found in tKe two 
groups of stibjects. 

.A-30- 
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Analysis ^ 

\ ■ This td?t ofthe mixed income- hypothesis violated the 'requirements 
established by the Department of Labor. No control" 'group v(as used in this 
stud}, and the distribution of subjects by training class is not clear.. 
* HcaieJjer, the pre and post data collected were amenable to sophisticated 
I statikti'cal analysis, and this i? a big plus. MBA believes that^^with a 
] contrcJl group add^d, this test could -prove, more enlightening with respect' 
to th^ workability of the mixed income hypothesis. 



V 
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CHARLOTTE, NORTH CAROLINA 



\ Charlotte proposed to conduct a ten percent mixed income test but 
never implemented it. The proposed program would have provided trainsitfon 
services for mixed income youfbT^i-^he job placement rates of. the mlxe'd^ 
income group subjeQts would have been compared to the job placement rates 
of subjects nd^in mixed inc<jnie groups. 
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' MIDDLE fiEOJRGIA CONSORTIUM '^ 

Introduction . , , . 

An Aerospace Careers and .Exploration program iyS being conducted at 
the RobWns Air Force Baie in middle Georgia. This t^st started Jn FY 1978 



and wi\l concludet^in FY 1979. It provides^skilled training^and counseling' > 



to out-oVschool' youiili. Data are inconclusiyjs* until ^completion, of the pro- 



gram operation, 
- Test Approach 



The mixed income test program or Ife'Tjera^ace Careers and Exploration 



program at Robbins Air F.orce Base provid'es full-time employment and training 
opportunity for 30 youth. Worjc teams are assigned to work sites representing 
approximately 20 occupatiorral groups such as mechanic^il, food services, 
'clerical and laboratory/technical . -» . . 

In addition ^to on-the-job training at^the work siites, youth receive 
dnstruction in preparation for the GED. examination, and counselors provide 

\ 

help anc^ advice with personal, family and legal___firDblems. Counseling 
consists primarily of one-on-one assistance, lind periodic group counseling 
sessions are scheduled for rap discussions. ^ 

Data Collectiorv Strategies • . * 

■ Program applicants were tes^e^d wit? the Stanford Diagnostic, a career ' 
interest profile and a sen^xit interviews. Th^se are the basic predata. 
No post- test was- administered, -but there was follow up to" determine the 
extent of u'nsubsidized emplojSient following program invoTvemgr 
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-Vlhile tHe-bottom line vyas unsubsfdiz^d employment, rt was difficult 
to-»get trainees onto^ the, aMropri ate >Civil /Service Register^JmJ virtually 
impossible to 4deHtjfy „thd§e who wjere registered. Work site supervisors 
|ad wanted to provide regular full-time positions at the end of the trlining 
program but wef e "precl uded from .doing. so-'|ecause of the register constraints. 
° >• ' '""^^ 

Analysis .... " .■ ^. 

J . ' • " 

, Thisxis an interesting approach to employment 'development ar\d "* 

certainly an exce*1^t way^to utilize the resources of the local air force 

base. 'However; because data collejQ,tion^d not'employ the best strategies, 

no* defi,hitive 'results are available- It is not cleaV- that a control group 

was used,' nor ts it clear t|iat the mixed income hyppthesis was tested in 

. ••'^ ' ' '■ ^ - ^ ^ 

this program, ^ * 
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TENNESSEE ESALANCE OF STATE 
UPPER CUMBERLAND, TENNESSEE 



Introduction 

This sunme^rogram consist^ of a varie^ty of work experiences, for- 
out-of-school youth. Pre^and post data were collected and analyzed, but ^ 
these data yielded no statis-tical signif\cance~with respect to .the mixed 
income hypothesis. ^ . " 

Test Approach ' • ' . / " 

The ten percent demonstration program was conducted' in FY 1978 by 
the Cordell Hull Economic. Development Corporation (CHEDC) and the Upper 
Cumberland Human Resources Agency (UCHRA) as subcontractors to the Tennessee 
Balance of^tate. The two subcontracting agencies followed an identical ' 

s 

program design but' provided different types of work experience. This 
program was operated from July through September 1978. and was designed to 
provide out-of-school youth with a variety of work experiences. 

All parti cipantt were rec>uited for and referred to the project 
by the Department of Employment Security- Offices, and all income verification 
was done by these offices. Original total enrollment (for both subcontracti'ng 
agencies combined) was 104, but eventually this was reduced to 88'subjects 
because of attrition. 

The 'experimental group was cbmprised of a two- to-one ratio of 
^ non-income-eligible to income-eligible youth, .and the control group consisted 
of income-el igTbtrymith exclusively. An attempt was made to match subjects 




3 



in the control and experiinefYtaVflWuprwith respect to age, sex, marital - 
status, school grade completed, grade point' average, race and inco(ne. 

The UCHRA* subjects were employed at various work sites, including 
a nursing home, a county courwduse, a day care center, the Upper Cumberland 
Human Resource Agency and Tennessee Tech. The CHEDC subjects were employed 
in day care centers throughout the counties. Work experience was the only 
service provided to test participants in this mixed income program. 



V 



Data Collection Strategies ' ^ 

Tfoe pre- and -post- test instrument was a questionnaire designed by 
members of the Manpower Planning Section of the Tennessee Department of 
Employment Security. This questionnaire consisted of four sections covering 
worK history, work attitudes, vocational trainjng history and occupational ■ 
awareness.. The section on work atti4udes was the most cflosely examined - 
and analyzed. In addition, natjurail observation was used by supervisory and 
interviewers *^ho made periodic reports on participants' progress. The. 
measurement of overall work attitudes was obtained by comparing the pre- 
and post- test answers posed on the questionnaire in this section. 
Statistical analyses involved the utilization of the t-test for determining 
the significance of the difference bStvSerT means of matched groups. No' 
statistical significance was observed in these data using the t-test analysis. 

)■ . ■ ■ '- 

Analysis , 

< ' ^ 

' * » 

^ This test of the mixed income hypothesis did adhere to the established 
research requirements. However, no statistical significance was observed. 



X 
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This may be because the test period was tcro short and control subjects 
were added fairly late in the research effort. This test should be 
repl4,cated with correcti-Ons for those observed problem areas. ^ 
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ANN ARBOR, MICHIGAN ' 



Introduction 



Five school sites' irp\nn Arbor were used to conduct this mixed 
income test with handicapped youth. Youth were not- paired by income in ' 
job settings, but they did interact in the classroom. Results indicated 
that the handicapped youngster does benefit from such a program. 

Test Approach . " — . \ 

This, mixed income test was conducted over a five- and- a- half-month 
period from January to mid- June 1978, Th^ program provid^ v/ork experience, 
classroom instruction, counseling and supportive services to 19 parti^- 
pants. It was implemented within five separate schools of the Ann Arbor 
school district. * \ - 

The test group had ten slots and was equllly mixed between tncome- 
filigible aijd nonincome-eligible handicapped youth. The handicapped 
students were emotionally disturbed and/or developmentally disabled youth, 
T*ie controTgrbup consisted t)f nine in-school youth who were income eligible 
and not physically or mental ly1fiandi capped. The experimental group wa? 
biiilt from referrals ,of local school special education teachers. Income 
wa? not verified, butHocal residency and in-schobl status were verified. 

• The work experience of the participants consisted of part-time 
calreer employment, which averaged 15 hours weekly for a 15-week period. 
Many different work sites were utilized, and, because attainment of work 
site cojnni tments was difficult for the handicapped population, no attempt! 
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vas madelo pair income-el ig1bTe\nd nonincome-eligible students while on 
thfe- job/ Classroom instruction included career orientation and ^abor market^* 
information. Counseling ser>?"^es were provided as- were supportive services',- ' 
such as medical and transportation assistance. Interaction between income- / 
eiigibl^and nonincome-eligible students, when it. occurred, was only in the 
classroom settijig, . * 

Data Collection Strategies ' j 

No .pre- or post-testing was conducted. The staff did evaluate f 
participant progress on the basis of attendance records, employer, performance 
evaluations, academic -work, ^duration of placement and reasons for termination. 
None of this i-nformation was systematically examined by income grouping. 

The results of this test very cleaYly show a positive effect for the 
^handicappecyoungster. On measures of attendance, academic performance and 
"pOsUive "termination, 'hancfi capped participants Tared qui t&~wen". ^ 



ffnaly 



sis 



Despite th6 good results re'ported, this test did*not provide an 
adequate demonstration of^lte efi^ects .of mixing youngsters by income. It 
demonstrated that handicapped^^gsters could achieve, but, since tliey 
were not compared to other, handicapped youngsters, the effects of mixing by 
income are unknown. This particular test di d^moriltr^fe the high^moti vation 
to succeed ai^^ong the handicapped, but it should, r^ot/e considered a good - 
test of the mixed infcome hypothesis. ' - • 
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Introduction 



FORT WAYNE?'INDIAfi'A 



This in-school prograip^for high school seniors was designed to 
provide work-study opporttini ties for the hard to'place student regardless 
of family income. The hard to place are usually physically or emotionally 
handicapped. Results were statisttc'all-y nonsignificant. 



r 



'^■ Test Approach ' ^ ' . 

The ovefall purpose of this mixed income demonstration test was to 
study perceptual judgments of participants about education,, acceptance of 
self and others, and S/Uperi or- subordinate relationships when income-eligible 
clientxwere mixed with nonincome-eligible clients. This mixed income test 
was an in-school program conducted from January to June 197B. High school 
juniors^and senior& wereUhe subjects. Control and experimental group? 
were used. • ' . ^ 



The program, entitled "Cooperative Work-Study Placement, \was designed 
to provide training station placement for hard to place students. The r ' 
. nonincome-eligible' participants were r-equired to meet the priitfVam's nonincome- 
reTated criteria,* such as being physically handicapped or in need of an ' 
opportunity tj^ prove themselves *nd wflling to conwU themselves to regular 
i attendance in the program. 

The program services included paid employment at aj'ob site and 
classroom instruction. wS'rk experience included 15 to 20 hours of. employ- 
ment per week under the guidance of the nonprofit employing agency's 
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' regular supervisbrs. Typical sites were piLlic schools, city and county 
offices, chins care centers and" hospitals.. The participants in the 

r ' 

experimental group were paired at tp work sites accordthg to mixed income 
whenever .possible. Cl.assroort i7»5truction was under the tutelage of 
vocational teacher-coordinators. According to>;th^ CETA st?iff, the greatest 
amount of interactibrv between income-el igiile and noninqome-eligible parti-^ 
cipants occurred within the classroom. ' The experimental. group also received 
. special counseling attention not received by the control group.^ This 
counseling was in regard to career choice, human relatjans, superior-su 
relations andV self -concept reinf^^ement. 

Data Collection Strategies , ^ 

Pre- and post- tests were used that measured subject perception ot 
education, self-worth. and superior-suboTdinate relationships. 'Evaluation 
~ ^data^were gathered using standard CETA ^oirarn^ crTteri^ S^ev¥ra1~iraTiTti^l 
tests, were pe<::£9rmed, including the analysis of variance. No statis- 
tically significant findings resulted,, however^ an d^ CETA planning ^ " ' 
- staff suggested that descriptive statistics, rather than inferential • 
* statistics, might have been more useful. They also mentioned the short 
length of the project (six months) as a pbssible factor in the lack of ; 
significant resuJts and suggested a project length of at least 12 months as 

4 

more appropriate. * ^ * . 

\ * • 

Ahalysis- - ' . ' . ' 

• / In this test of the mixed inconle hypothesis, as in others reported 

here, information that would affect futur^ YETP planning was not developed.. 

■f 

No conclusive findings can be reported. Furthermor;e, this test violated 
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one of the j*equ^reiitfents of the mixed ^ncome expferj merits sitice the experi- 
mental group received m6re services than the control group. The only ' 
differenpe between the two groups should 'have been in the cora'posttion of 
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INDIANA BALANCE OF .SWE . ■ ' 



' ^ Introduction . . * - ^ 

This report covers two tests of the mixed inCome hypothesrs conducted 

by .the Indiana Balance of State prime sponsor in Columbus, -Indiana. The ,FY 

1978 test provided transition services to mixed income subjects, and it 
^ ^yi elded no conclusive findings. The FY 1979 test provided an alternative 

school program for pregnant women; no defi.flitive dataware available on the 

FY 1979 test. 

Test Approach- ^- * 

the TY 1978 test/provided a nunber of "transition to the world of 
work," services tj? high school' students. These^were job seeking seminars', 

A ' , » . ^ 

skills training activities and actual job placement- The number ef parti- 
^cipants involved and the ratio of income- eligible to nonincome eligible was 
not known. ^ ' ^ 



s 



The -FY V979 teste's providing the same transition services to, a 
special group of subjects." These subjects are all enrolTed in an alternative 
e^'-SphooT for pregnant women. The number of participants and the ratio of^ 
, -Hjcome eligible to noninc-ome eligible is mot known. 

Recruitment for program participation was handled through newspaper 
•dds, announcements in the schools apd simply by word of -moufh. "Family 
incomes were verified by requesting that parents submit payqheck stubs and 
• ,by' spot checking. ■ « 



Data Collection Strategies * ^ 

Pre- and post- tests were used, but it is not clear what variables 
and/or attributes were measured by these tests. No results were available 
to MBA -tft thfi time of this study. 

^. ' / 

-Analysis . ' , * ^ 

— I — 

There was not enough information available to MBA to analyze the 
effectiveness of either of these tests of the mixed income hypothesis. 
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INDIANA STATE EMPLOYMENT' AND TRAINING COUNCIL' 
BLUE RIVER. VALLEY SCHOQt CORPORATION 



Introduction : 

-This in-schooV test involved an examination of 120 variables from 
those related to demography to attitudes and levels of motivation, A 
major emphasis of the classroom and on-the-job work is on the acquisition 
of marketable skills.^ No conclusive jlat^ are available now. 

Test App/oach 

Forty-five youth were included in this tes^^rograip- Nineteen were 

nonincome eligible with family incomes ranging from $10,500 to $22,500, 

Twenty-six of the youth were ^cbme eligible \iHh families having no 

me?isur€ble income. The subjects were diyided into, two" program groupings by 

■age. Fifteen subjects we r^1n> grades 7 through 9, and another 15 were in 

grades' 10 through 12. An additional 15 youth served as controls receiving 

the same, services as subjects except they were not mixed by income. 

« » • 

Students were chosen for participation in the prog.ram bas^a-cin 
recoirmendations from teachers and g.ui dance 'couns'eloYs. Selection criteria 
included students' poor academic performance'^ their potential for dropping 
out ^ school and/or their involvement with the juvenile criminal justice 
' system. .Students with poor self-concepts, low communication. skills and^ 
Tittle interest in the schooT system's traditional offerings v/ere sought. 
/\.ll participants were interviewed by a counselor, psychologist and the 
Program Director befbre final selection. 

The demonstration training program combined remedial academic 

education with a work experience for dropout-prone youth. 
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Data Collection Strategies 
* • , Over 120 variables of interest were ide^ified and tracked. These ' 
n variables included age, sex, grade placement, and type arid amount of, family. 

- ' Income* The six major changes measured Were types of termination, cl^r\ges 
in academic level, changes in school attendance performance, changes in 
grade point average, graduation rate and supervisor work site performance 
^tings. Pp^e- and post-'tests were used along with examinations of school 
records and work. site supervisor evalua.tions. < 



Data were still being collected apd analyzed 'at the time of the 
MBA investigation. rHowever, some preliminary findings. were presented 
which are intriguing land suggest the need for additiojf/al study. 



' ^ Some perfq|Tnance measures are goingu;^ be statistically 
--significant when the analysis jkTcqmp^ 

*. • 

• A noticeable growth is apparent for all subjects in 

problem-solving abilities ^ 

.0 All subjects (.income eligible and nonjncome eligible) 

appear, to hpive gained from the mixed" income experiment, 

: . and the growth of the income-eligible youth does not 
appear to have been at the expense of the growth of 
the nonincome-el igible youth 



r 

Ana 



This test of the mixed income hypothesis was elaborate and interestinn. 

• ^ "a 

However, the sample size seemed to be much too small to adequately examine 
change in 120 variables. A larger sample size is, reil^ommended in any 
proposed replication of this test of the mixed income hypothesis, 
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' INDIANA STATE EMPLOYMENT. AND TRAINING COUNCIL 

HARMONY SCHOOL ' iC^ 

IntT^oduction • ^ - > 

Harmony School, an alternative high school, provided a number of 

services to participants in this mixed income test conducted from April 

1978 to April 1979. Emphasis was placed on improved academic performance. 

' ' . \ ; \ . ^ ' - - ' 

Test Approach ^ . ^ 

HamionySchool was already comprised of a heterogeneous groi^ of 

students mixed by income, so 41 of these students (ages 14 and over) were 

/ ^ 
selected as subjects. The experimental grbup was mixed by, income, and only 

income eligiblesj^er;^ in the control group. ' « 

Services provided to the participants included family counseling, * 
""Bmeraency hou5ing, academic classes and transportation. 

Data Collection Strategies 

Pre- and postftests. were administered to 4neasure changes In verbal 
and math skills resulting from the-^periment. Results were not analyzed 
at the time of the MBA investigation, but three observations were shared 

^ • . ' - ^ - ' ' 

with the MBA staff: - 

• Verbal and math skMls Increased if) five percent of 
the participants . • " • 

t Attendance increased in*' ninety percent of the ^fiarticipants 

• ^Ificome-eligible and nonincome-eligible subjects seemed to 
benefit from the mixed income setting ^ . 



Analysis 

Insufficient information was provided to MBA to adequately complete 
this analysis. For instance, .neither the ratio of income-eligible subjects 
•to nonincome-eligible subjects nor the extent of income difference was • 
known. The nature of the pre and post instruments used was not described. 
Without this information, it was difficult to assess the quality of this 



test of the mixed income hypothesis, 



\ 



\ 
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' ' LANSING, MICHIGAN . 

Introduction « ^ / 

This report cpvers two tests of the mixed income hypothesis conducted 
by the CETA administration in Lansing, Michigan, Work experience and 
classroom training were key services delivered to subjects in the FY 1978 
test. Subjects were mixed at job sws and^in classrooms. The results were 
that control subjects {those no.t mixea) scored higher than 'the experimental 
subjects on. pre- and post-tes^j measures of attitude, motivation and the like 
However, the experimental subjects showed more significant change in scorjes 
^rom the pre- to the post- test, Jhe FY* 1979 t^ is a replication of the ^ 
1978 effort, and nro, results are available, \ 

Test Approach . ' ' • 

The FY 1978 mix^d income program was run from January to September 
1978 under a subcontract with the Lansing School District. Two high sch'ools 
served as sitesTone high school served only the control group (all income 
eligible.), and the second provided the setting for the experimental group 
;(mixed income). The control group, contained 30 youth, and the experimental 
group had 34, who'were equally mixed with income-eligible and nonincome- 
eligible youth. , ' 

The FY 1979 test is very similar. However, it has an'^ditional 

control group that is provided no training. This group will help account 

for the percentage of change due to intervening variables from the environ- 

r 

ment'or chance. ^ 
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The mixed income component provided basic^^services similar to those in 
other YETP programs. These services were outreach, orientation, assessment, 
career- related work experience, transition counseling, career information, 
personal counseling, skill training and placement on unsubsidized jobs. 

Interaction between the income-eligible and nonincome-eligible youth 
occurred at the job sites and during classroom training, Pajpticipants were 
paired at the work sites so that income eligibles were working with nonincome 
eligibles. 

The program participants, particularly the "influence group" of 
nonincome-eligible youth, ^ere selected through referrals from school 
counselors the two high school sites. The income range of the nonincome- 
eligible youth was from ^10,000 to as high as $40,000. The youth were aware 
of being part of a demonstration program but were unaw'W-tjf^the nature of" 
the test. 

Data Collection Strategies 

Pre- 'and post-tests were used to measure changes in attitudes about 

% 

self and work, levels of motivation, job seeking skills and general career 

awareness. The parti di pants* grade point averages were examined, and a 

follow-up was conducted. The findings from the FY 197i3 study were 

interesting. 
« 

• Members of the control group had higher scores on 

' the pre- and post-tests of attitude toward work, 
^ motivation toward worK ahd knowledge'of job seeking 
skills than did members of the experimental group 



The amountHof change from pre- to post-test 
wa§ more significant among members of the experi- 
mental group than the control group 



e grade point average of the experimental group 
dropped while that of the control group rose slightly 

There are no results to report from',the FY'1979 test. 

Analysis . * ^ \ . 4^ ^ 

The results of this test must be weighed against the small sample 
size and the limited time period Tone school term). There was also little 
control in regard to intervening variables; and it was difficult to substan- 
tiate outcomes by virtue of economic mix or no mix. An additional and 
important factor to consider, was the use, of two high schools^that may be' 
two very different environments in terms of educational philosophy an^ 
teaching skills; these differences could have been a primary reason. for the 
unusual growth of the control group. These learnings -gained from^ ttie FY 
1978 mixed income test are being examined more critically in the FY 1979 test. 



. / 
■ / 
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MACON COUNTY,. ILLINOIS , 

Introduction " • . 

^ Potential ^dropouts were identified and enrolled ^in a work-study 
program iti this FY 1978 test of the mixed income hypothesis, this test was 

conducted between January apd June 1^78, but it yielded inconclusive results. 

^ Z • , 

% * * 

Test Approach ^ 

♦ 

The Wprk Experience and Career Education Program (WECEP) was designed 
to provide potential school dropouts aged 14 an£J5*with opportunities for 
part-time employment and career education. Counseling and training. in 
career development, life skills and job skills were additional features of 
the program. The goal of the WECEP was to reduce the number of 16-year-old 
dropouts. wRCEP was. the subcontractor for this test of the mixed income 

hypothesis, nhe local public school district provided program coordination, 

I 

classroom- instruction and assessment services; CETA provided work experience; 
career 'counseling and supportive services. ^ 

The youth in the mixed income demonstration, as participants in the 
overall WECEP, received all the above services. Sixteen youth were in 
the test program. Eleven, almost equally mixed between Jhcome eligibl-e 
and nonincome eligible, formed the experimental group; fiye income-eligiBle 
youth served as the control^group. The nonincome-eligible participants were 
,\from families in the fliiddleuto,>upper middle income range. AIT partfcipants 
were selected on the basis of high absenteeism from. high school. 
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, Pjita Conectjon Strategies *^ , ■ 

The program was Reused on improving the participating youths' 
self-copcepts 3nd attitudes toward scho9.lf The results of the demons t^a'ti on 
were measured by attendance at school, grade, point avera'ge, discipline in 
school and at work, ,and on-the-job work performance. Information to measure 
the above items was gathered from soWol recdrds, CETA forms, on-the-job 
supervisors and pre- and post-tests. 



The findings wei^e inconclusive with respect to the mixed income 
hypothesis, but they were interesting in other areas. For instance, it was 
found that 82 percent-of the subjects in the experimental group showed an 
increase in grade point average compared to only, 40 percent of those subjects 
in the control group. Work attitudes and attendance rates increased for 
both. groups, and the number of disci pi inary'^cases was reduced for both groups. 

AnaTysi s • ' ^ , 

This test, like many others reported in this study,' suffered becausfe 
% of its very small sample size. The research requirements were adhered to^ 
-but^the small sample size made it almost impossible p achieve results of 
any significance. ^ ^ , . - 
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Introduction 



N 

MILWAUKEE, WISCONSIN 



Participants received university-based Instruction lin the various 
^llied health fields. This instruction N«iS designed to deliver marketable 
skills. A very high attrition rate affegtted the collusiveness of the 

findings from this mixed* income tesi=r~ 

^ 



Test Approach - ' 

The Milwaukee experiment combined classrcJok-^y^a+f^V^ with work 
experience. 1 The University of Milwaukee, School of Allied Health Professions, 
was the subcontractor for the classroom training. Youth and Elderly j 
Together— Project Invp.lve, a local chore service agen^, was the subcon- 
tractor for the work experience component. Both subcontractors were located 
in center city Milwaukee. 



There were 56 participants in the program, 31 of whom were in the 
experim^tal group and 25 of whom were in the control group. .The Youth^^and 
Elderly TtW^her agency performed all of the application/intake procedures 
and assisted the locaVjob service agency in verifying income. levels. A 
*wide range of difference in students' income levels was not reported. Final 



selection of all participants was handled jointly by the University and 
Youth and Elderly Together. How pan^Jci pants were distributed in terms of 
income eligibility was not known. ) 

Classes were held on the university campus from May through July^ 
1978. ■ SuBjects were provided wUh approximately 100 hours of training 
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(15-22 hours per week) in four skill ar^as: nursirr^, health maintengirufg, 

( "^^^i^S 

.home economics and interpersonal lemming. This rjraining was intended to 
provide students with skills that they could jjts^ in the work experience 
component. 

^ The work experience componfeQt provided individual placement for 
participants in the home^of elderly persons where they could practice and 
improve the skills acquired in- training. Assignments included chore 
service, housekeeping, meal j)reparation an d^ personal services*! Other 
participants made visits to elderl^ citizens and arranged social and' 
r^eational activities (inost notably an end-ofvthe-program pionic for 
^jfiiith participants and alderly clients). ^ X 

Data Collection Strategies 

Measurement of change i^attitude and attajpmfent was based on a 
questionnaire that served as both pre- an^^post-test. The questionr\aire , 
consisted of true/ false questions concerning general employment-$eekihg 
activities and some -specific requirements for employment in the /field of 
allied health. The pretest was administered^ to ^11 participant^ upon 
entrance 'into' the program. AltliougK an Attempt was made to^ha^e both the 
pre- and post-test questionnaire data coyiected^qn each indivj/duaV, many 
participants were not queried a second time because^ they dropped out of 
the program. Other students refused to complete the questionnaire at 
program termination, . ^ • > , 

. r • " :' ^ ■ ^ 

*A final rese^h report was not available; however, some observations 
and preliminary resuj^s were shared with MBA. For one thing, students whi^, 
were nonincome eligible seemed to have career aspirations and knowledge 
about how to achieve them. Income-eligible youth had similar aspirations 

■ 144 . ' • 




but lacked the resources and knowledge necessary for achievement. In 
addition, for all subjects, job placement after the program was very high. 
Seventy-one percent of the participants-had a positive termination and 
job placement, , ' I 

Analysis 

The Milwaukee mixed income test program was structured to meet 
the research requirements. However, the results of the program may - 
not be statistically significant due to the amount of particip^nt^urhover. 
Furthermore, coordination between the two subcontractors was poorly handled' 
and may account for the inconclusive findings from this test of the mixed 
income hypothesis. A future test of the mixed income hypothesis in 
Milwaukee should emphasize decreasing the iJ^tVUion rate and should consi<J|r 
only one subcontracting Igency. ( .'A / / 
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RACINE, WISCONSIN ^ - 
-TRICO-CfTTTtONSORTIUM 



Introduction 



P]is case study reports on tests of the mixed income hypothesis 
conducted by the td\:o-CETA Consortium in FY 1978 and FY 1979, The FY 
197§^test involved in-scjiool youngsters from income-eligible and ndnincome- 
eligible families who were mixed in an urban work-study program. The 
income-eligible youth seemed to improve more |;han the nonincome eligible ^ 
regardless of groupings. ^ The FY 1979. test'is essentially a replicatfion of 
the FY 1978 t^^'ia a rural setting/ No data are^vailable, • 



Test Approach ' ^ t^": . ' ^ . ^ 

The characteristics oT. the FY 1^78 '.arid FY: 1979 test proaram 
participants were similar: ^ the youth l^ere p^jmarily white malesVlS or 16 
years ol<t* Both test programs were for i?i-*schboV youth^^The f&mily 
income range for the nonincome-eligible subjects in the^FY 1978 program « 



ranged from just over CETA income guidelines to $4QifoOOJ rt\contrast, 
the^amily income for eQl the nonincome-elfgiblemrtictfant^ in the FY 
1.979 test program was just over CETA eligibility^uideK^^es by $1,000 to 
$2,000. 

The FV 1978 test l^ad an experimental groi/b ,o\^ subjects equally 
mixed between income eligible and noninfcome eligible and a control group 
of 15 incomes-eligible youth." The FY f975 experimental group had 13 
participants, 5 of whom were nonipcome eligible. 



The program provided in-school you.th with transitional services and 
career employment experiences. The staff described the program as an 
eniployability techniques learning and skills develofjment effort geared 
'toward job seeking and job maintaining. 

The mixed income test ,prografh combined a variety of employment and 
training-related services from a workshop that prodded. classroom training 
in. employability skills development to on-site work experience, I^aVticipants 
began th^ir on-the-job experience while participating in the cUssroom-type 
workshop. Job sites included post offices, lopal schools and handicapped 
centers where the youth were often employed in maintenance or aide positions. 
In both tests of the mixed income hypothesis, an effort was made to pair an 
inconTe-eligible youth with a nonincome-eligible youth at the work site. - X 
Pairs were determinfe^^by similarity in age, sex arid work interest. . This 
feature of the test program was more successful/y incorporated into the FY 



Data Col>§ction Strategies 



1979 program th.an it was in the FY 1978 program. 

Techniques used to measure change^yier^e pre- and post-tests and ^ 
observation. The pre- and post-tests used for the demonstration programs ^ 
were ^ieveloped by the Education Division of the Singer Company as part of' 
an employability techniques package'for program deliverers called Job 
Survival Skills PrograiKfor Independent Living. , It uses true/false questioris 
.'that measure attitudes aiKl beliefs -about communication techniques, the 
importance of education and resources available for job seeking and 
maintaining. Observation of participant performance and attitude change 
was conducted on several different levels from the subcontrattor staff . 



to counsel ors^and-i^prksliop leaders to pa rtiei pants' Supervisors at the 
work sites. Work performance.^ and attitude were measured through observa- 
tions of behavior such as regularity of attendance, punctuality and changes 
^ in quality of work. ^Classroom performance and attitude were measured 
through observations of such behavior as amount of participation and 
preparation and revelations regarding self-concept. 

The mixed income staff noted few differences between the income- \^ 
eligible youth apd the nonincome-eligibTe youth. Th^ youth of the higher 
income families were described as neater in appearance and more courteous, 
but the results of the FY 1978 test showed little difference in performance 
or attitude, between the two groups. The staff stressed that the employment 
and training needs of both income groups .were the saine. A differ§nce 
between the FY 1978 and FY 1979 program participants, they said, is that 
the rural youth have additional drawbacks in that their area has less 
" industry and no public transportation to those jobs that are available. 
The FY 1979 test may yield more signifi^atff^f indings. No ^ta were reported 
on the effects of mixed income groluping. 

Analysis ^ - ^ ; 

^ . These tests of the mixed income hypothesis adhered to the researcf) 
guidelines es^ta^shed by the Departgient of Ubon. However, they both 
faTT^ to demonstrate anything signifi«6nt about the effects of_mi;(ed Income 
grouping. In both tests, the' sample size may have been too small to adequately 
measure change, and in the FY 1979 test the income difference was very small. 
In both^tests there seemed to "have been no real focus on the effects of 
grouping; more emphasis seemed to bft on comparing, income-eligible youngsters 
to noriincome-eligible youngsters. 
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' RAMSEY COUNTY. MINNESOTA 

« 

Introduction 



This test was designed to serve^ handicapped youngsters through 
counseling, on-the-job trainijijg and job placement. The test was discontinued 
shortly after it started, ara there are no data.- ' ' • 



Test Approach 

Twe>ity-five slots were to be provided, almost equally mixed between 
income eligible and nonincome eligible. Services were to include job site 
development, counseling and on-the-job training. This program, however, 
apparently^ met with a number of problems, and, according to a prime sponsor 
representative, it was discontinued shortly after initiation. The exact " 
dates of operation are unknown. 

Data Collection Strategies 

There was no information on how data^were^ , 

Analysis 

There was not enough information available to MBA to analyze the 
effectiveness of this- test of the mixed income hypothesis. 
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ROCKFORD, ILLINOIS 



Introducttoh , ^ ' v ' _ 

In-school youth participated in a work-'stlidy program; Pre-a^nd ^ 

post measures'' Were collected. Results have not been artalyzefl on thtsr,FY 
1978 test of the mixed income hypothesis 



Test Approach . ' / .'. • . 

The mixed income test program was designed for in-school youth ' • 
and was conducted from March 15 to June 15, 1978. The program was 
conducted in several classTX)oms of dfre school district. The participating 
students we?e provided with career awareness' and self -awareness/self -esteem 
training and on-therjob work experience. /Work ejcperiencfe was primarily 
With private <fi«:tor employees. ' - 

7 

Eligibility/for CETA income-el ig-ible participants "was, determined 
byjprior eligibility in the school district's lunch program. Nonincome-' . ^ . 
eligible o'outh were selected through referrals from school counselors.. . ., 
Basic criteria ^included poor attendance and/or grades and were used/to . .•; 
identify youth having problems in school. Thirty noniticome-eligible and .-/ 
15 income-eligible youth participated in the mixed income program. The ' ' 
subject 5r:pup waS mixed in the classroom, setting; the control ^roup attended, 
similar classes but at a, different time. The yo.ujt^h were unaware 'df-the , ■ . _ 

y ' ' ' . '' T " ■ V • ■ N.-'^' ' 

demor^stration nature of the program as were the on-site employers; only ^ ,\i 
the teachers were aware of the tej^ being conducted. , • ..v ^ 
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Data Cal-l€ct1on Strategies 

Program 'participants were administered Coopersmith's "Self-Esteem 
Inventory," Rosenberg's "Self-Esteem Scale" and- the Norw'icki -Strickland 
"Locus of Control for Children" as ipre- and post-tests. Wh.ile specific • 
.variables of Jnt^reSt were not identified, the primary focus, was increased 
self-concept in regard^ the world of work.- Inc^^^eased performance at 
school and the acquisition of a job„were additionally .desired behavioral 
outcomes. Another technique for data collection was the use of self- 
administered questionnaires and document review of CETA and school • records. 



Data collected fjjr the mixed income teSt. have not been collated and 
analyzed separately from that of the total YETP program. Prime sponsor 
reffresentatives mentioned lack of funds and lack of awareness of- outside 
interest inl^the.test results 'as the reasons that these'data have not been 

. ( ' . . , 

analyzed. It may be pertinent to note, however, that there" was little to^ 

3> ■ ■ • * ' 

no growth measured by the pre- and. post- tests administered to the Vetp 

population. Jhe prime sponsor's anrjtfal report stated that "a person.' s 

, sel f-cpncept. is a personality trait which remains celatively stable over 

time." • . ■ . • . - ■ 

- Analysis 

/ Marjy of the research requirements were met by this test of the 
mixed income hypothesis. However, the failure to analyze the data 
specifically generated by this test was a serious oversight.; This failure 
made it impossible for the Rockford CETA to offer any conclusive results 
regarding the mixed income hypothesis. » ir _ , * ^ 



ERJC, . , , , A-62 



ST. PAUL, mInJI^SOTA • 

I ntroduction 

This FY 1978 and 1979'"t«st of the mixed income hypothesis provides- 
part-time employment as an incentive to. remaining in .school. All partic- 
ipants must be pursuing a jhigh'school diploma or its equivalent toVemain .. 
active.*. Data were not systematically collected, and findings are incon- 
clusive. . ' 

Test Approach 

Independent School District #625 was the subcontractor for the 
FY 1978 and 1979 mixed income test in the city of St. Paul. The school 
district established ttie Center for Youth Employment and Training^ CYET) , 

* c 

4 

which functions as a central coordinator for all youth manpower services. 
Services of the CYfT are the Youth Employment and Training Program for 
dropout youth; the Youth eoinnuni'ty Conservation and Improvements Project ^ 
for out-,of- school youth; the Youth Career Exploration Jjnd Employment 
Project;, and the state and Federal St.. Paul SUmiier Program for Economically 
Disadvantaged Youth. CYET also refers youth to Job. Corps, the Young Adult 
Conservation Corps^ and other youth-oriented community organizations.. 

In this test of the mixed income hypothesis spanning two fiscal 
years, particular emphasis is placed on communicating to youth the 
importance of. education in securilig future employme^it. This is done by 
requiring that all participants stay in a school program in ^der to 
qualify for youth employment. The work experience provided is fully 
subsidized for up to 2Q tiours per week =in noj;ri)rofit and governmental 
agencies. 
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,The general distribi>t1on of participant activity is 20 hours per 
week of classroom training and 20 hours of work experience. The program 
provides a numberyo^ alternative education modes for out-of-school youth. 
After enrollment, all participants are required to actively pursue completion 
of high school through either attending a traditional high school, enrolling 
for a General Equivalency Diploma (GED) through St. Paul public schools, 
or attending an alternative school program. 

The work' experience consists of part-time employment at minimum wage- 
in nonprofit and governmental agencies in the areas of maintenance, child 
'care and clerical work. All work sites conduct 1,riitial interviews with the 
youth and explain the nature of the job requirements. If a particular type 
of work presents a conflict of interest with the participant, the project 
staff attempts to find an alternat^ placement for that youth. All partic- 
ipants receive career development counsel ing, various supportive services 
and referral to outside sources for special services as needed. ^ 

The mixed income program participants are racially mixed (white, 
•black, oriental, native American and Spanish American) and are from ages 
16 to 21. All are school dropouts. All participants seem to have a sense 
of alienation from the educatiqnal system, from work and from the home 
environment. Family incomes spanned a range from $100 above the usual 
income requirement to over $35, GOO, The number of subjects and composition 
of the experimental and. control groups were not reported to MBA. 

Data Collection Strategies 

, The subcontractor is responsible for maintaining an academic profile 
of each mixed income participant as well as conducting monitoring activities 
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)at each work- site aboiit once every two weeks. Work performance and attittide 
are observed through behavior such as pi^nctuality, personal appearance and 
changes in quality of work, and academic progress is measured by attendance 
and improvement in grade point average.^ 

Results of the mixed income test are described in terms of partici- 
pant change.. The observed changes were an increase In participants 
positive self-concept, improvement in persoqal appearance and improvement 
in the- participants' willingness to accept the responsibility of steady 
employment. ^ 

Analysis ' . ^ 

Many elements germane to a rigorous research "design , were not included 

in the program. For instance, there were no control group, nO pre- or post- 
al 

tests and little income mixing. Respondents felt that this program delivered 
essential services to youth in an effective and efficient manner, but the 
prograili did not test the mixed incbme hypothesis. ^ 
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WAUKESHA, WlicONSIN 
WOW CONSORTIUM 

* * . - 

Introduction 

» Handicapped youngsters at two sites were given a work-study 
.experience In a mixed Income setting. These subjects were compared to 
participants. In Title I programs, and -the mixed Income subjects showed 
more satisfactory performance. i 

• * 

Test Approach 

Fifteen subjects participated In this study of the mixed, income 
hypothesis. Rive of these subjects were Income eligible, and these youth 
were In jjlose and constant Interaction with nonlncome-ellglble subjects.^ 
All were handicapped. 

a 

/ 

/ The program offered vocational technical training In" food service ■ 
and automotive repair. The group also developed denature center at the 
high school. 



Data Collection Strategies 

OutcoiB^s were' measured by successful completion of the program and 
attainment of employment. 'Measurement was based on performance outcomes of 
the participants, and little use was made of pretests. An unexpected and 
highly dfslrable program outcome was that the class of handicapped youth 
became a much more Integral part of the student body and the behavior of 
the students toward members of the special education class was much 
Improved. - ^ 



i5o . 

A-66 



Analysis 1- 

Thls test did not meet the research requirements established by 
the Department of Labor. There was no control group,' and systematic pre- 
and po?t-tests were not li^ed. The sample size' was small, and the test 
stipulated few additional controls. This program.may have provided some 
job opportunities for handicapped youth 1ti\ Waukesha, but jlt was not a 
test of the mixed Income hypothesis. 
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.L COASTAL BEND CONSORTIUPI '• 

Introduction \ • • 

This dropout Veventi on program was based in, two schools. The first ' 
school was a traditional instituti*H<i»i{h J second was an alternative . V_ 
setting. ^No post-test was used; therefore, findings are inconclusive. 
Change was observed in dress and attitude of participating youth. • 

The Coastal Bend Consortium encompasses about 450,000 people, '. 
and half of these live in the city pf Corpus Christi,. Texas. The other 
half are distributed throughout the 12 rural counties that are also a part 
of the.-Cdastal Bend 'Consortium. The mixed income. test^wSs* subcontracted 

■ 

to the Corpus Christi Independent School District. 
Test Approach 

The fornidt of the mixed income test^was the traditional work-study ^ 
program with the addition of car'ier counsel ing. From March 1 to September 
30, 1978, 56 participants received four hours of work experience and four 
hours of classroom training and counseling each day.^alf of these were 
nonincome-eligible subjects. Each participant received academic credit 
. and a minimum wage for time-spent at the work site. 

Data Collection Strategies • . , 

All participants in the mixed income study took a vocational 
interest inventory designed to facilitate program placement. The inventory 

was not used as a pretest 'instrument, and thero were no post- tests used. 

^ 0 / 
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However, counselors/and other program staff observed participant 
progress and looked for indicators of change such as attitude, interview 
behavior and other job-related skill acquisition such as the completion of 
application forms. Observers tried to get a sense of participant initiative 
and confidence. 

Because data collection was, unsystematfc, therr-ai;e no conclusive 
findings to repor'b>-^he impressions provided by counselors and other staff 
are that attrition was^omewhat lower f of- the mi)(ed income group, that 
there was change in dress and attitude, and that nonincome eligibles seemed 
to benefit overall more than the income eligibles. ' . ^ ^ 

Analysis ' . 

This test of the mixed income hypothesis violated the research 
requirement of the administration of a pre- and post- test". Therefore, 
there are. no quantitative data to report. It is also not clear whether 
subjects \vere matched on such variables as age and ethnicity. " For instance, 
in at least one of the schools used for this study, all the income- eligible 
youth were Hispanic, and all the nonincome-el igible youth were white. The 
impact of cultural differences was not measured or even considered. 

c 



\ 
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; . OUACHITA PARISH POLICE JURY V 

Introduction 

Thjs work-study program almejl to provide a part-time job placement 

' r 

for each, participant. No pre- or post-tests were tised, but test personnel 
reported no difference? in behavior in mixed or nonmix6d groups. • 

Test Approach ^ , 

Ten participants composed the mixed income group. (6 nonincome 
eligible), and 22 participants (all income eligible) were included "in the 
control grouf^. These youth received various services while particiQjiting 
in the mixed income test. The services included outreach, assessment, 
orierttatiaij, counseling, career information and guidance, job placement 
and job site monitoring. The test ran from February 1978 to the end of 
^ugust 1978. , > 

Data Col lectlfljy Strategies ^ iff ^ 
Methods employed to measure outcomes were attendance, attrition 
rates, nonpositive terminations, and attUudes and habits as observed^by 
couaseTors and supervisors. Pre- and post- tests were mt%lhiiinistered, 
and on-the-job interaction observed between- the two income groups could 
not be used as a measure because the town mi not large enough to have 
industries capable of employing more than one student. 

Although the interaction betw^n income eligibles and nonincome 

« 

eligibles. could not be observed at job sites in this test of the mixed 
income hypothesis, the general feeling expressed by staff and counselors 
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was that there were no differences- in the behavior of mixed or nonmixed 
group participants. FurthermorjB, observers found that income-eligible 
participants, regardless of the griping, had^ore nonpositive program 

terminations than did the.nonincome-eligilxle participants. 

* ' % 

* 'v* * * 

^e other interesting observation was related ^o the effects of 
^ob site placement. Students employed at Job sites away from the school 
seemed to acquire more maturity than J;hose students employed by the 
school- Exposure to anotlfer facility seemed to be an important difference 
fqr these participants in the jnixed income test. . 

Analysis ' . ' . 

The failure to' use pre- and post- tests seriously decreases the 
•conclusiveness of this test of the mixed income hypothesis. Furthermore, 
'the mixed income hypothesis cannpt be truly tested since income-eligible 
and nonincome-eligible youth did not interact on job sites, and it is not 
clear what the interaction was like between the two in othejl activities. 
All data reporterd above are Jiighly impressionist!^ and cannot be considered 
reliable indicators of the effects of this test. 
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OMAHA, NEBRASKA . . 

Introduction x 

This career exposure program, managed by the Girls Club of Omaha,, 
includedVounseling, guided group Interaction and on-the-job training. 
Participants were all female. yPve and post measures were used but were 
still being analyzed at the time of this repQrt. Results will be available 
at ^ later time. 

Test Approach " - " 

The Girls Club of Omaha, a&NA subcontractor to the Omaha CETA 
program, provided a Career Awareness ^ogram tcr^in-school girls, aged 16 to 
19, from January to September 1978. One hundred four subjects participated 
in this program,' and they were evenly divided between the experimental 
and control groups: Unfortunately^, "it is not clear how subjects^were 
'distributed by income groups. The pxperimental subjects {&2) are those . 
who participated in: the Career Awareness program; the control subject? (52) 
had no involvement in the Career Awareness program. 

/ ' 

X Th6 Career Awareness program Included group. counseling and inter- 
action, lectures and discussion, all of which were geared toward exposing 
girls to the many options available to them in the world of work. Decision- 
making skills were emphasized in these group activities. 

Each experimental subject completed a needs assessment phase,' which 
concluded when she^ developed ^ personal contract for goals to attain during 
the program period. This .contract noted* career areas. of interest and 
highlighted potential placement possibilities, 

\ • ,. 



6 . \ 

Each experimental subject complfeteck/^three-week- intern period 'at 
a businesjs- or professional ^setting related to th6 subject's interests. 
Th6se intern^ placements were always in facilities with female role models 
at all levels of the business. 

^Data Collection Strategics 

Experimental and control subjects were gi'ven pre-- and post-tests 
using the American College Testing Prograifi's "Assessment of Career Develop- 
ment" instrument. Prior;^to exposure to the Career Awareness program, 
experimental "and control subjects were fairly similar on measures of job 
values, working ^eonditjjpn. preferences, career plans and career planning 
knowledge. 

Though data, are still being analyzed, a preliminary analysis indicates 
that experimental subjects do appear to become more responsible and indepejid-. 
ent in terms of .career planning after the Career Awareness program. ContrM 
subjects do not show similar changes. However, there has been no analysis 
of these data by income group. ' 

Analysis . * 

This test of the mixed income hypothesis was carefully constructed ' ^ 
^nd implemented. Data regarding income distribution are available to the 
test administrators, but these have not been analyzed. It is not possible 
to conf4rm or reject the mixed income hypothesis based on the Omaha test. 

The administrators of this test rated it very hi ghly-^u^ expressed 
confidence in the workability of the mixed income hypothesis, they noted 
that the addition of nonincome-e3igible participants was good and was a 
boost to the Career Awareness"* program. 
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WICHITA, KANSAS 

The mixed income tesj proposed Tor FY 1978 was never actually^ 
operational ized because of delays in funding. An attempt at program 
initiation was made in Ap^il, but it was abandoned in May at the close of 
the school term. The program enrolled orvly six participants during this 
interval and offered no services. There are no results to report. 



■ / 
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^ . ' ARAPAHOE COUNTY, COLpRADO 

Introduction ' ♦ . , ' 

This' te^t of the mixed income hypothesis was perceived as a' way 
to include nonincome^eliglble youth in a typical YETP activity. Although 
no pre- or post-tests were-administered to program participants, there 
seemed, to be a tendency for, participants in the mixed income group to have. 
,more ^positive attitudes at the termination of this work-study, in-sc^iodl 
•approach to the *mixed Income experiment than participants in the nonmixed * 
group. ^ ' / 

Test Approach • " * 

This program was des?^ed to provide part^icipants with career^ 
employment ^experience, on-the-job ;training, counseling and transition 
services. The program was conducted from January through September.30, 
1978, dQring which time 28 students participated in the mixed 'income test. 
Fourteen of these were income eligiblis who formed tjifi control group, 
..and there w^s a mix of 14 income and nonincome eligibles in the experimental 
group. All income verification was conducJ;ed tijrough parental/guardian 
intake *fonns. ; . 



All students were interviewed individually prior to final selection 
Selection was based on "matching sample". cViteria, including age, sex^ 
position in family and fami.ly Status. ^ • 



• St* • 

^ The program provided part4cjpants with on-the-job training and 
career employmjent. experience in local public service agencies. Jhe 
'youth were closely mulched acCorcfihg to the selection criterfa— age, 
sex, position In family and family status— arid the experimenk^l g^noup- 
worked side 'by side at*the. job sites,^ ' , • * 

Data* Collection Strategies 

No pre- or post-test was administered to participants. Besides 
.the^'nitial screening interview; the only data collected were those, 
gathered from an exit interview conducted .by the same person who had 
interviewed the student previously. The exit; ifiterv lew w^as used to 
determine changes in* attitude and motivation resulting from the program. 
The test administrator's and counselors were knowledgeable o'f *the researcV 
effort while students and supervisors w&re unaware Of any testing. ^ <^ 

The overall results showed a tendency for the experimental group 

to have it higher positive termination rate, although all youth were 

equally interested irt continuing to hold- down a job. It is implied • - 

that the e)^^peri mental group fared better on termination because of its 

mixed income cpmposition. 

» * 

f ^ ' . 

Analysis > . ' * , ' 

This test of th6 mixed income hypothesis, like marty others, 
suffered frpm poor' data collection strategies, unclear variables and 'a 
small sample, size.. However, the matching of parti<:ipants v/as carefully 
planned, and there was a high' level of interaction achieved between 
participants in the mixed income group. ' •» ' ^ ^ 
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•• - BOULDER COUNTY, COLOfeW)0 

* ^ ^ ^ 

Introduction . * - 
^" ""5 . ' . ' 

In this test of the mixed income hypothesis^ handicapped and rural 

youth were placed in work experience situations and also received intensive 

one-to-one counseling. Although there was no systematic testing or data 

colTection, it was, reported that this program filled a local need in 

exposing employers to the employabil ity of handicapped and/or rural youth. 

The Boulder-County CETA serves about 180,000 people in the city of 
Boujder and the rural and mountainous areas surrounding the city. This 
community is the home of .the Univ^rsity'^of Colorado and is only 23 miles 
from Denver. Although unemployment is not high, underemployment is a 
problem^ since the cost of llyng is high and wages are lotST. 

^; . Test ^Approach ^ • . 

^ ' ^ . The Boulder County mixed income test was conducted from January 
to September 1978 and was unique in its focus on handicapped and/ rural ^ 
youth. The handicapped youth were placed in work experience situations, 
and they received intensive one-to-one counseling and exposure to career 
: ' ' e*(!ucation. This portion of th6 expertmental program^ was implemented through 
^t. a contract with the Center for People with Disabilities, a local organiz- 
\ ^ ati'on that is geared to providing jobs for handicapped youth and adults. 
. - Th^ focus on rural youth was to fill a severe need in Boulder County for 
•jobs rfhd services for this population. The lack of 'local businesses and 
" * governmental and human service delivery agencies serving as work si.tes 
I , severely impairs work assignments for rural youtM This portion of the 
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experimental program was "Tlfiplemented through a contract with the Nederlahd 
Community High School, and these participants received services similar to 
thosejjrovided to the handicapped 'youth. ' i 

Data Collection Strategies ^ . ' . ^ 

There were no pre- or post- tests administered. "However, data - 
were collected, informally regarding program success, .employment and the like 
The most significant change observed was in the emp^loyers, who were able 

to see handicapped and rural youth as potentially reliable employees. 

/ 




Analysis' 

This was not a test gf the mixed income hypothesis. As far as MBA 
can gather, there was no mixing by income or even conditiO|j» that is, 
handicapped participants apparently worked only with each other, and >rural 
participants worked only with ea^ch other. Pre- and post-tests were not 
administered, and even the observational data were not systematic. This, 
program did respond to some special needs in Boulder County, but it adds 
no informatiort on the effects of mixed income grouping. 
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NORTH DAKOTA- BALANCE OF STAT^ 

Introduction 



T / 



• This FY 1979 test of .th6 mixed income ^hypothesis is being conducted 
in four rural communities under thfe auspices of the North Dakota Balance 
of State CETA office. Participants are involved in'community improvement 
projects. ^ , • . 

Test Approach 

Each of the four communities participating in th^is study has six 
youth involved. In two of the communities, all^of the youth are income 
eligible (these are' the control subjects); in each of the two remaining 
communities, youth are mtxed on'a 1:1 ratio by income, that is, one-half 
of youth income eligible and the other half are norfincome eligible. 
Family income wa^ scri^ened to determine income *el igibility. 

Each group ^youth works with adults to plan and implement' a 
project that will benefit t|ie total community. Youth also receive 
training and vocational' counseling in the course of their l'Tivolve«ent in ' 
the, community improvement project. • . \ * 

Data Collection Strategies 

There were no pretests, used, and no .post-tests are planned. 

Impressionistic data are meager and nonconclusive. Everyone connected \ 

with the tesi-is aware of it>s operation, but no one is collecting -data to 

determine the outcomes. * • ' . 
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Analysis . ♦ . ^ 

This test conducted by North Dakota <is not a good example of a 
test of the mixed income hypothesis. Data collection is nonexistent, and 
_the quality of the interaction between income-eligible and nonS'ncome-eligible 
youth is questionable. 



SJ-- 



J 



1 f^^) 

o 



s 



A-80 



Ci«.IFORNIA BAUNCE OF STATE 

Introduction 



r 



A variety of work experiences was provided to in-school youth from 
six area high schools. Pre and post measures were used, and these data 
yielded no significant differences in attitude or motivation resulting 
from mixing by income. This test was conducted by Placer County under 
subcontract to the California Balance of Sta*« prime sponsor from February 
to September 1978. 

» 

Test Approach 

' ■ , « 

The Placer County program was designed to provide a variety of work 

experiences to in-school youth. A total of six high schools representing 

three school districts participated in the program. Participants in the 

experimental group worked in mixed income groups at job sites; control 

group subjects were" not in mixed income groups. " ' ^ 

There were 15 work sites situated in various locales within the 

county. Most of the sites were schools, but there was also a day care 

center, library, social security offices and an- association for retarded 

persons. There were 32 subjects in the experimental group, half of whom 

were income eligible, and there were 16 control group subjects, all of 

whom were income eligibly. 

■> • • 

Data Collection Strategies 

All participants were interviewed and surveyed to determine goals,, 
attitudes, basic values and vocational interests The survey instrument 
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used was the "Stucjent Career Attitude Survey," This survey instrument 
represents r portion of a larger battery d^eloped by the San Bernardino 
County Office of Education to be used in gathering data on work study and 
work experience education programs. Each participant completed the 
instrument at the beginning of the project in F^ruary and March 1978 and 
at the close of the program^ in August and September 1978. 

Although thefe were no significant differences in attitude or 
motivatiqgi resulting from mixing by income, some interesting findings did 
emerge in this study of the mixed income*hypothesis. These fin'dings were: 

• Teenagers, regardless of income level, prefer 

' socializing and are not interested in solitary 
activities 

• Teenagers seem to prefer working in ai* small group 
to working alone or in a large group 

• The nonincome-eligible youth showed, over time, 
some desire to work alone * 

• The income-eligible youth showed a preference 
for working with a variety of materials, compai^^d 

^ to the* nojiincome-eligible youth's preference to 

work with only- one item at a time 

• The inconfS-eligible. participant in the mixed income 
group seemed to have less of a realistic apprafsal 
of employer concerns than all other participants 

• ^ The income-eligible participants seemed to gain 

no appreciable benefits from ^working with the 
nonincome eligible ' . - 



Analysis 

* • 

^ This was a^good^test of the mixed income hypothesis. The research 
requirements were met; measurement techniques were appropriate and 
adequate. The results do not support the mixed income hypothesis, but 
they do shed light on other areas of interest. 
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MARIN COUNTY, CALIFeRNIA 



Introduction. 

' Mixed income subjects were engaged iji a variety of counseling,' 

^ educational and recreational activities during the test period in addition 

to a work assignment. Emphasis was placed on internal and external change. 

This test generated highly usable data, but there was no statistical 

significance observed, . ^ 

Test Approach 

The Marin County mixed income demonstration program was conducted 
from June to mid-September 1978 as a special component of the prime sponsor's 
sumner program. Youth participating in the demonstration rec^ved similar 

^ services -to other youth participating in the YETP activities k that. time. 
A primary outcome of the three- and- a- half-month program was work placement. 
Participants were paired at their job sites, that is, one income- eligible 
and one nonincome-eligibl>70uth per site. In addition, other services 
were provided to participants , such as counseling, labor market information, 
educational and vocational seminars, and reimbursement for transportation 

• and child care. " Social .gatherings" and cultural activities were scheduled ^ 
during this summer program. ^ ^ 



tifty-four slots were provided^ for the demonstration program. 
Fourteen income-eligible youth composed the control group, and the. ^ 
experimental group was mixed with 20 income-eligible and 20 honincome- 
eligible youth. The income-eligible^youth were selected from regular 
'enrollees in the CETA sutimer program. 'The nonincome-eligible youth were 
chosen from referrals by the school district, and yotith were sought with 
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demonstrated initiative and academic success. The farfiily income of 
nonincome-el igible youth varied widely. 

Pcita Collection Strategies 

Dalta were collected frd(ri the participants, their employers, 
participants' co-wfi^kers, CETA staff and written documents. Measurement 
techniques included stai)dard1zed tests, employer/supervisor and participant 
co-worker written evaluations,' self-rating scales and interviews with 
participants and employers. 

Long-term follow-up research is planned to measure job placement rate, 

level of employment and degree of effort and success in endeavors to achieve 

J 

career goals. This research Is ongoing. 

Data generated by the mixed Income test were assessed for all program 
participants in terms of: (1) pre and post performance and attitudes of 
the income-eligible participants In the experimental group; and (2) the 
pre and post performance and attitudes of Income-eligible participants in the 
experjmental group versus those In the contrdl group. Unfortunately, this 
focused analysis and the clear specifi^ion of performance and attitude 
outcomes did not result in statistically significant findings. There are no 
conclusive results to report. 

Analysis 

This test of the mixed income hypothesis was well constructed. It 
is unfortunate that the results were nonsignificant. * ' 

The project staff felt that i^ was important to learn that this type 
of employme^nt training was of benefit to youth regardless of income. The 

I A.84 i73 



staff -also felt that the mixed income factor had a crucial effett on 
change In performance or attitude. Perhaps a larger sample size and a 
longer test would show. this effect statistically. , ~" 
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MONTEREY COUNTY, CALIFORNIA^ 



0i 

This program was geared toward potential school dropouts and paired- 
work experiences w1t)i academic instruction. The results were statistically 
.insignificant. ^ • ' ^ 

Test Approac-h - 

^ This seven-month program was conducted from March to September 1^78 
by the Monterey Peninsula School District under subcontrac^to the, Monterey ^ 
County CETA administration. Career infoknatipn and experience were pro^/^ided 
to 36 youth aged 14 and 15. ^ 



The' program was called "ExecutiVe Internship," and participating 



youth were placed, ^r example^ in the offices, of the mayor and the school 
principal. In addition to^tt^s wo/k 5ite experience, the youth were ' 
provided with weekly seminars on career orientation, basic career information, < 
counseling, 'job seeking techni^^ and transportation assistance. 

Half of the 36 youth formed the control group and half formed thre 
experimental group. The experimental group was equally composed of income- 
eligible and noniticome-eliglble youth. The family income pf th/ nonincome- 
eligible youth ranged from just above CETA income guidelines to $20,00p. Members 
of the experimental group were paired by income at the work site.sV Additional 
interaction withia the , experimental -group occurred at weekly seminars and 
groupy discussi-ons. All 'students were aware of being participants in a 
demons t/atiorf program and the nature of the research. ^ 




Data Collection Strategies 

Pre- -and post-tests and document review of the youths' performance 
were the primary measurement techniques. These techniques w^re: a pre- 
and post-test of attitudes; a'pre- and post- test using the Kuder interest 
inventory; an analysis of school and job^site attendance before ^during 
the demonstration program; and a written job sKiUs assessment instrunent. 
"Analysis was then conducted to compare^ the growth between the youth in the 
control group with -that of ^thejjTCome-eligiblei»Vouth in the experimental 
group, and the growth of nonincony-eligible youth was compared to the growth 
of t-he Income eligible. .' ' . - 

Unfortunately, the results of the Monterey County mixed income 
program' were statistically insignificant, and the MBA respondent was unable 
to point *to any Useful information gathered from the findings. 

Analysis 

This test of the "mixed income hypothesis was wel^onstructed. 
Larger numbers may yield significant resuUs if there is a replication. 
All other research requirements were met. 
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. NEVADA BALANCE OF STATE -S^ 

Introduction 

An alternative vocational education program was the main service 
provided to mixed income subjects in Carson City. - Jit included counseling 
and work 'experience. However, no conclusive results can be presented. 

Test /Approach 

This test of the mixed income hypothesis was subcontracted^ to the 
Churchill County School District. The Churchill County School District 
had been running Project SAVE, an alternative vocational educational ^ 
program, as well as a suttmer youth program, and was in a uniquef^osition to 
extend its services to nonincome-eligible youngsters in mixed income 
grqupings. 

Participants received v^ycational guidance, personal counseling, 
peer counseling, vocationaLinstruction, work experience and classroom ' 
twining. Subjects were/17 and 18 years old and were identified as being 
dropout prt)ne. The e^erimental program started with 23 youth (3 were 
high school dropouts,' and 20 were identified as potential dropouts) and 
ended with 18 yoiith who were provided some one-on-one. career exploration 
and personal^ounselijfig. The experimental group received allowances 
plus credits -toward graduation for attendance at 'special vocational edu- 
cation \cnasses. 'Some of thp youth were place^in part-tijpe (afj:er school) 
employrnent with public sector, agencies. It was unclearCvthfitljer these were\ 
^^isidt^ed or unsubsidized.XThe control group youth, were involved in 
Project SAVE (a certified special education program for the hijgh school 



grades.) and were provided with intensive car^r exploration^ personal 
counseling, rap groups, training in Job i atepyi ^ews. job survival skiHT, ' 
and work site placement in the private sectar. w . 

The approach to income mixing is^ not clear, although it fs known 
that income-eligible and nonincome-el tgible subjects participated, Thos^e^^ ^ 
"Who were nonincome eligible were only marginally over the CETA income figure. 

Data ^CoUectipn Strategies 

Participants were , tested by the employment serv^e at'^he time of 
their admission to the program. A vocational interest test was administered/ 
^ by staff from the University of Nevada, Both of these were used for assess- 
ment purposes rather tttan^'being considered part of the exp^iraental design. 
No post-tests were administered at the completion of the experimental project. 

The observations of the Counselors concern perceived differences 
^ .between income-eligible and fionincome-eligible participants. For instance, 
those who wei?e not income eligible were' perceivel^ tq have increased self- 
^confidence> as a result of the program^- Those who were not ^ncome eligible 
/ seemed to be able to delay gratification better and were jfiore like.ly to"" 
V- save their ea^aings to purchase large items than were those who were income 
. -eligible. . ' ^ ^ . 

Analysis " ^ - ^ > 

This test was poorly constructed^ and implemented. There were mawy 

. contradictions noted by MBA between stated intent and actual outcome.^ ^ 

Specific research requir.ements were not met, and there are no results 1>o ^* ^ 

report. 'One of 4:he problems seemed to be in. the commyn<c|'t16n network , , 

' C ' ' ' ' i^T^ 

\u % ^ , ' , » . ^ , / * - 
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within the CETA agency^ The purpose of the mixed Income test was not 
.explained to test administrators; it appeal red. that the proposal for work 
mi^ght not have been shared with other nelevani;^ personnel/ 
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This ih-school pfogram })rovided two to- three months of- work 
experience fot- "each participant. Pre- and post- tests were used, but 
interactTKjn between income eligibles and noninconie eliglbles was almosl 

sir <- - * W ' • 

absent, making it vintually fnpossible to tfest the niixed, income- hypothesis. 

Test Appro.ach , " ' 

This progrW ifsa^d the basic work experience model. The most - 
^^^^ignificant modification of the model Was the locally imposed linit on the 
•niinber of weeks that a participant ibu^d spend in a work experience component. 
•According to the contract, 120 youth, ages 16 to 19, were to be enrolled 
in work experience for a period n6t to exceed 180 days with an average 
duration of 70 days. An experimental group if 60 participants was established 
with 22 i ncome- eligible and '38 nonincome-eligible subjects.. Within this 

■ ' - • ■' ' . 

■ group there was a mi){ of participants in probationary and nonprobationary 

status, and they were' matched by^'grade, race, age and sex as much as ''-i-. 

.■possible. A'similar mix was established in a control grpup of 40 parti' 

. ;cipan^s, "all of. whom were income eligibl><- 

* ^"^"'"^ ' ■ • - 

Another significant fe^ature of this test of 'the mixed income hyp.o- 

thesis was the usi pf subjects on ,jud[icial 'pi^ation. The Department of 

Probation became the subcontractor on this project in order to secure job .f 

.placaflent and tfaining for tts clients on probation. 
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' Data Collection Strategies 

Upoji entry each youth was assessed regarding work- related attitudes, 
occupational goals and awareness, work history, and achievement in language 
and math skills. Participants then'received a work site assignment based - 
both on. the kind of work experience desired by the participant and the 
availability of that particular kind of work site. The nature of the work 
Sites was such that only one partflTh^P* could be assigned; thereb/ decrees- 

. ing the potential for interaction between those youth who were economically 
disadvantaged and those who were not. At program termination, subjects were 
again tested though not as consistently as they had been at entry. In 

. addition to pre- and ppst-tests; some folVow-up of subject status after 
prograf:. participation was attempted. 

There were no conclusive findings reported on the mixed income 
hypothesis. It was found that subjects who were on probation were more 
likely to, look for, jobs after the program, was over than were those subjects ' 
not on probation. In addition, job placement was fo'und to be no more • , 
difficult for those. on probation than for those ^no't on probation. 

Analysis . * - ^ . . ^ /; ' ' ' 

^.^ This was not a test of the mixed income hypothesis. This was a look 
, at mixed gcouping, but the two groups were Subjects on probation,and sub- 
jiects not on probation. No control group was used, and any conclusions 
drawn with respect to the mixed income hypothesis are highly speculatiive. 

'• • \ . • .... • . • - " . 
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/ ; / ' ^ U. »S. Department o)f Labor ^ ' ^ 

. Employment and Training, Administration. . ' . 

" . . ' ' Office of. Youth. Progtams^', , ^ 



The. Issues * * * . . 

The Youthi Employment and Demonstra'tion Programs authorized by 
title II of the Youth Emjjloyment and Demonstration Projects Act 
(YEDPA) se«ks "...to e.stablish a variety of emplayment, training, 
and demons t;: at ion programs to explore methods of dealing with _ 
the structural unemployment problems of the Nation's youth. The • 
basic purpose of the demonstration programs shall be to t^st the 
relative efficiency of different ways of dealitng with these 
problems in diff erent . local contexts....." It was intended that _ . 
the results would be used-a's a basis for im.proving the design or 
future emploi-rnent and training programs for youth. 

As one aoTsroach to such exploration, sectidn 345 (a) (2) of, YEDPA 
authorizes che use of 10 percent of the funds available for Youtn 
Employment and Training Programs (YETP) to include youth from all 
economic backgrounds in order to test whether^ or tf^ wha t exynt 
inccm.e eligible youth (those whose familv income is no more than 
85 percent of the lower livinc standard income level) would , 
benefit f^ron workmc with ar^e being trained ^alonc^ide orher^ Inon- 
mcorre elicible) youth as opposed co receivinc rhfe same services 
m projects wnere all participancs. are income eligible . It i^s 
the purpose a»f tnis paper^ to present options On how such tests 
may be carried* out and im.portant , considerations for test design 
and implementation. 

There are Widely varying viewpoints about the wisdom of targeting 
programs for the most economically disadvantaged. These viewpoints 
need to be understood in designing, any test of incom.e, mixing . _ 
Arguments against targeting Usually begin with the claim or verti- 
cal inequities, i.e.,' that youth -above any arbitrary income 
cutoff may be as much in need a:s those below. Targeting is. Justi- 
fied by the belief tiiat scarce resources should go to those m.ost 
*in need, and that the economically disadvantaged have far more 
severe problems than the nondisa'dvahtaged. For YETP, Congress 
has limited the more costly services to the more economically 
disadvantaced or in'oome elicible (yauth from families with income 
less ^than 85 percent of the SLS Ibwer living standard)'. The 
notion to be tested is whether these income' eligible* youth would 
be betteJ^'served by participating in programs serving youth of - . 
all econom.ic backgrounds. - There are several ' arguments as ^o why 

.this m.ight be expected. ^. ' " = ( ■ 

■• ^ ^ <. 

' 1. How" the income Qlicisle taight benefits from particip'ating .in 
' mi;xed income programs ." -Re-search results have suggested that 
program effectiveness jt)ay be influenced by the availability of 
"positive role. models among partieipants , the atmosphere , and 
approach within t^e-.^ragram , a-nd its reputation for success in 
th£* community U'f' is well doc^umented that youth are highly ^ 

• sensitive to' peer -^-rfeup pressures. A peer group atmosphere which 
^is indifferent or, ,in extr.eme cases, hostile toward v/ork cyr 
"•aca^demic achievement may make ft very difficult to Achieve-' 

• orocr'am goals. -Positive attitudes tfoward work and society are, 
on thd -average, directly related to family income, and behavioral 
orobljrr.s such as- juvenile delinquency are inversely related, - 

RIC . • • ' 
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(.a) The tvo or mpre special components and the types of 
. services and activities. The experimental croup of income 
eligible and other participants should be ass-igned to one or 
more program services or activities and a <:omparison group of 
only income elici^sle participants assigned to", one or more 
parallel services or activities. _ The experimental and comparison 
* groups' program services and activities should be similar to 
^.ake it more likely that any differences, between outcomes will 
be dTie to the mixing of youth of different income^ .rather than 
other variables. The service, mix, costs, duration of services, 
and delivery agents* should be standardized as far as possible. 

(b) The services provided in each of the selected components, 
with any signifiqant differences noted and explained. 

(c) A lllan for recruitincr and assigning *part:^'pants f^to 
the experimental and comparison groups. The follina^ iteitTs should 
be, considered : 

• The, income eligible youth assigned to the groups 
should be similar^in terms of age, race, '?ex, education attained , 
and* status, court ^contacts , grade point average, and family 
income. If it /is feasible to do. so, random assignments -^f 
income eligible participants should be made to the groups. If 
this is impractical, assignm&s^t methods should be used which will 
keep dif f erertces between the income eligible youth in the- experi- 
mental and comparison groups to a minimum. 

• The. methods and criteria for recruiting, non-income 
eUgible youth for inclusion in the experimentaj. group (s) should 
be, described . * * ^ 

• A determination and explanation should be made of .the 
proportion ;of the experimental group' which will be noa-rhcome ^ 
eligible youth. 

• To the extent practical, the exj^erimental and compari- 
son groups should be the same size. 

• • Every iffort should be made to. assure that within the, 
experimental group assignments, the mix- ©f participants at various 
woirk, training, and service s^t^s reflects^ the ^mix in the experi- 
mental, group as a whole/ i.-e*, insure that the . income eligible 
and other youtii are not; segregated. For eWam.ple^-if the expels 
mental group is comprised of 40 percent i^icome eligible and 60' 
percent other then each .work, training, or service site should 
reflect this same^mix as nearly as possible. / 

(d) A description at ^'taff assfgned to' the project/ and ' 
program componen^ts. To ±he extent feasible, the staff "to serve 

^^each group should^N^ th^^same or similar. ^ 

^ • V • ^ - • 




(e) Reporting procedxares established, to collect reliable 
information 'about' the types of services provided to members of 
the experimental and comparison groups. Data collection methods 
should identify-' any 'differences in the services provided to the 
income eligible amd other members of the experimental and 
comparison groups. ^ ^ 

^ • (f) Program outcomes established for the .components. VThere 
•placement is an appropriate goal, this might be used, or more 
sophisticated measures su^h as quality of^ placements may be used. 
Other measures may be appropriate, such as tested gains in occu- 
pational awareness, changes in attitudes or return to school 
rates. ^ The program data on participants and -costs should be- ^ ^ 
tablulated- sepai^atlly for the experimental and comparison groups. 

2. ' Reporting Requirements , As required in the regulations, a 
report of the research results will be submitted to the Regional 
Administrator at the end of the, fisca<L year as part of the 
annual review of program 'operations axra a copy sent to the' Office ' , 
.of Youth Programs. Regular reporting forms as well as a \ 
narrative wi41 be required in this special annual report as out- 
lined below. The-.^hd of year , report will provide a basic 
comparison between the prograim outcomes for income eligible 
participants in the experimental and comparison groups ajid 
between income eligible and higher income participants in the 
experimental group Cs). ,i ^ 

(a) Narrative. The narrative section of the report stiould 
^ be prepared covering the points below: • 

An update (if necessary) of the research design that 
was submitted as- part of the annual plan; 

^ A description of any special probl^ens encountered 
during the da|^a collection process which might hav|^ an effect on 
the interpretation of the results. 

• AJ?y information Jsr obeservations on contacts and 
interaction.s betMi^een the i/come eligible and other youth in, the 
experimental' group; / ' * . 

• • The perspectives of participants on th6ir participation , 
in the experimental project. To a,scertain the information, 
\ participants jnay be briefly interviewed, br teisted upoji termination; 
in particular the. income eligible* should be interviewed- or teste<f 
to determine, whether , they perceived any benefits^ from the mixing 
of, participants; . • . v • 



• The conclusi^ons 'reached, from the anai^ifiK*pf the , 
ata including tesj^s of statistical signif icance^rrd' any other* 
nterpretation of the dat;;i which soetns^appropriate. 



^ •.Any recommendations for program design adrustments, 
if appropriate, ' 1^ . ^ 

(b) Forms. In addition to the narrative, other information 
in the end of year report should be provided through regular= 
YETP reporting forms. The information should be provided 
separately for (1) income eligible in the^ experimental group {s)^' 
(2) other (non-income eligible) youth in the experimerttal 
group (fi); (3) income eligible youth in the comparison group. 

The following data should be provided: 

•^VThat ar;e the characteristics of the participants in 
the various groups? The Youth .Quarterly Summary of Participant 
Characteristics (YQSPC) ^form should be u^ed for this part of 
the report. 

• V7hat types of 'services were provided ,to the partici- 
pants in the various groups included in the study?\The Youth ^ 
Program Status Summary (YPSS) form will be 'used for this part 
of the report, summarized^or the quarters of operation. A 
narrative explanation should be attached to clarify ambiguous 
Doints or to provide additional information. 

4* ' • \<hat vWre the outcomes after completing the program? 

The Youth Program Status Summary (YPSS) will be used for this 
part of the report. .Outcomes related to locally established ^ 
performance measures should be reported in narrative form. 

• What were the costs of the program? The Youth 
Financial^Status Summary (YFSS) will be used to report the 
finahcial information. ' , ^ \ - 

More Sophisticated Experimental Options 4, 

The research design described in the earlier part of this; paper 
is the ' minimum required for conducting t'he income mixing experi- 
ment program. Since the issue of relationship ibetween income 
ritixing.and pijogrckm outcomes is exceptionally coinplex, prime ^ 
sponjsors may wish to corxduct research which will test additipnal 
hypotheses'. ' Some examples are listed below: ^ 

• A particular percentage mix of income eligible youth 
may pe significant in terms of program benefits of outcomes. A 
large proportion of other non-income eligible youth milght be 
requirjBd before 'the impact of the'* role models can be. detected or 
before acceptance of ^11 participants byi^mploy»ers increases. ^ 
On ^the other\hand /the- income eligible might f^el increasingly 
isolated as thjgir share of parCicipartts declines. A stu^, might 
be^ designed com,pfiring the results ^of prcj^grams vith' dif^rerent 
pr,oportions of non-income--eiigible youth. - ^ 



• It is possible that income eligible or more econom- 
ically disadvantaged youth mliy be influenced most by youth whose 
aconomic situation is better but not too much better than their 
own. The income eligible may be able to better identify 'with 
youth from families vith stable work histories but v;ith modest 
incomes rather than youth from more , affluent families. A study 
might be designed in whicA family Income' criteria is raised 
sufficiently to qualify oray those -slightly 2ibove the eligible 
income criteria. 

• Prime sponsors may. opt to limit the comparison group to a, sub- 
set i.e. reconomically disadvantaged or those of other income levels 
below 85 percent of the lower living, standards and structure 
experimental groups to study the impact of income mixing on this jwb- 

set. t 

• An important variable may be the coping skills. of 
the youth rather than the income level. Poorly motivated income 
eligible youth may be most effectively influenced by working 
with youth who have developed good attitudes toward work and 
have done reasonably well in school and previous work employment. 
In this regard, there are a variety of simple tests which have 
been developed to assess work attitudes. Counselor . intefviews 
might bei used to identify more .positively oriented youth or 
success B.n school might be used as a proxy! A^primS sponsor might 
conscioifely mix motivated youth v.'ith other ran^domly selected 
income eligible youth, and compare the results v;ith a "project 
mixing the income* 'eligible and higher income youth. 

-•■A range of measures might be^se^ to. assess program 
effectiveness. Pre- and post-tests of a salmple of participants 
might be used to survey v;ofk attitu^S/ ocovupatiohal awareness r 
socia^lNvalues and aspirations. These da^ might be used to . 
test the relationship between the characteristics of^ participants' 
on entry, at completion, and on subsequent outcomes. Tot 
instance/ changes 'in attitudes and performance ratings during ^ y 
emploijment and training^ prograuns might be compared to unsubsi- ' ^ 
dized placement rates. . T ' 

'The -examples cited above are meant to be illustrative rather 
than .exhaustive, and prime sponsors are encouraged to use their 
ingenuity and experience in developing testable h\T>atheses.. There 
is no requirement for more than t^e minimum design and reporting 
outlined in' this papeit. However, more ambitious undertakings 
are welcomed and are likely to attract national^ attention ahd 
contribute to overall national' knowledge developmjent efforts as ' ' , 
well as local program decisionmaking. . . v ^ ^ 

The Office of Y^uth Programs will coordinate -and synthesize.; 
the special end of year reports author ized 'under this pape?: and* 
will make recommendations on changes in^ legislation or program 
guidelines which jippear to be indicated' on. the Stasis of the 

research results. " ' ' / , 
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